CONVOLUTIONAL NEURAL NETWORKS FOR DETECTION OF MALFORMATIONS OF CORTICAL DEVELOPMENT

Import packages and functions

In [1]:
import matplotlib as mpl
%matplotlib inline
from PIL import Image
import numpy as np
import pandas as pd
import os
from skimage.color import gray2rgb
import matplotlib.pyplot as plt
import matplotlib.cm as cm
from mpl_toolkits.axes_grid1 import ImageGrid
from sklearn.utils import shuffle
import tensorflow as tf
from tensorflow import keras
from tensorflow.keras import activations
from tensorflow.keras.preprocessing import image
from tensorflow.keras.preprocessing.image import ImageDataGenerator, array_to_img, img_to_array, load_img
from tensorflow.keras.models import Sequential
from tensorflow.keras.layers import Input, concatenate, Dense, Dropout, Activation, Flatten, GaussianNoise, BatchNormalization, GlobalAveragePooling2D, Conv2D, MaxPooling2D
from tensorflow.keras.optimizers import Adam, RMSprop
from tensorflow.keras.applications.vgg19 import VGG19
from tensorflow.keras.applications.inception_v3 import InceptionV3
from tensorflow.keras.applications.resnet50 import ResNet50
from tensorflow.keras.applications.inception_resnet_v2 import InceptionResNetV2
from tensorflow.keras.models import Model
from sklearn.metrics import confusion_matrix
from sklearn.metrics import accuracy_score
from sklearn.metrics import roc_auc_score
from tensorflow.keras.models import model_from_json
from tensorflow.keras import backend as K
from tensorflow.keras.utils import to_categorical
from tf_keras_vis.gradcam import Gradcam
from tf_keras_vis.saliency import Saliency
from tf_keras_vis.utils import normalize
from sklearn.metrics import classification_report
In [2]:
# Define image size
mpl.rcParams['figure.figsize'] = (20,24)

FIRST PART: DATA INGESTION

Data description

After having trained and validated our CNNs, we will test them with the test data:

-338 normal MRI images from 17 control patients

-186 MRI images of periventricular nodular heterotopia (PVNH) from 6 patients

Import original images

In [3]:
# Unzip files
!unzip ~/data/Controltest.zip -d ~/data/
!unzip ~/data/PVNHtest.zip -d ~/data/

# Remove the zipped files
!rm ~/data/Controltest.zip    
!rm ~/data/PVNHtest.zip  
Archive:  /home/ubuntu/data/Controltest.zip
  inflating: /home/ubuntu/data/Controltest/1.1_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/1.10_SAGITTAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/1.11_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/1.12_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/1.13_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/1.14_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/1.15_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/1.16_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/1.17_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/1.18_AX MPRAGE RECON_83.jpg  
  inflating: /home/ubuntu/data/Controltest/1.19_AX MPRAGE RECON_87.jpg  
  inflating: /home/ubuntu/data/Controltest/1.2_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/1.20_AX MPRAGE RECON_91.jpg  
  inflating: /home/ubuntu/data/Controltest/1.21_AX MPRAGE RECON_95.jpg  
  inflating: /home/ubuntu/data/Controltest/1.22_AX MPRAGE RECON_100.jpg  
  inflating: /home/ubuntu/data/Controltest/1.23_AX MPRAGE RECON_103.jpg  
  inflating: /home/ubuntu/data/Controltest/1.24_AX MPRAGE RECON_107.jpg  
  inflating: /home/ubuntu/data/Controltest/1.25_AX MPRAGE RECON_111.jpg  
  inflating: /home/ubuntu/data/Controltest/1.26_AX MPRAGE RECON_115.jpg  
  inflating: /home/ubuntu/data/Controltest/1.27_AX MPRAGE RECON_120.jpg  
  inflating: /home/ubuntu/data/Controltest/1.28_AX MPRAGE RECON_124.jpg  
  inflating: /home/ubuntu/data/Controltest/1.29_AX MPRAGE RECON_132.jpg  
  inflating: /home/ubuntu/data/Controltest/1.3_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/1.30_AX T2FLAIRSPACE RECON_101.jpg  
  inflating: /home/ubuntu/data/Controltest/1.31_AX T2FLAIRSPACE RECON_108.jpg  
  inflating: /home/ubuntu/data/Controltest/1.32_AX T2FLAIRSPACE RECON_113.jpg  
  inflating: /home/ubuntu/data/Controltest/1.33_AX T2FLAIRSPACE RECON_119.jpg  
  inflating: /home/ubuntu/data/Controltest/1.34_AX T2FLAIRSPACE RECON_128.jpg  
  inflating: /home/ubuntu/data/Controltest/1.35_COR T2FLAIRSPACE RECON_100.jpg  
  inflating: /home/ubuntu/data/Controltest/1.36_COR T2FLAIRSPACE RECON_106.jpg  
  inflating: /home/ubuntu/data/Controltest/1.37_COR T2FLAIRSPACE RECON_111.jpg  
  inflating: /home/ubuntu/data/Controltest/1.38_COR T2FLAIRSPACE RECON_115.jpg  
  inflating: /home/ubuntu/data/Controltest/1.39_COR T2FLAIRSPACE RECON_120.jpg  
  inflating: /home/ubuntu/data/Controltest/1.4_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/1.40_COR T2FLAIRSPACE RECON_125.jpg  
  inflating: /home/ubuntu/data/Controltest/1.41_COR T2FLAIRSPACE RECON_133.jpg  
  inflating: /home/ubuntu/data/Controltest/1.5_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/1.6_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/1.7_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/1.8_SAGITTAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/1.9_SAGITTAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.1_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.10_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.11_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.12_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.13_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.14_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.15_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.16_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.17_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.18_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.19_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.2_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.20_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.21_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.22_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/10.23_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.24_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.25_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.26_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.27_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.28_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.29_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.3_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.30_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.31_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.32_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.33_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.34_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.35_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.36_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.4_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.5_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.6_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.7_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.8_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/10.9_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/11.1_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/11.10_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/11.11_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/11.12_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/11.13_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/11.2_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/11.3_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/11.4_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/11.5_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/11.6_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/11.7_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/11.8_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/11.9_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/12.1_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/12.10_CORONAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/12.11_CORONAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/12.12_CORONAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/12.2_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/12.3_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/12.4_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/12.5_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/12.6_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/12.7_CORONAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/12.8_CORONAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/12.9_CORONAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/13.1_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/13.2_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/13.3_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/13.4_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/13.5_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/13.6_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/14.1_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/14.10_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/14.2_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/14.3_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/14.4_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/14.5_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/14.6_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/14.7_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/14.8_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/14.9_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.1_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/15.10_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/15.11_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/15.12_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/15.13_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.14_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.15_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.16_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.17_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.18_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.19_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.2_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/15.20_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.21_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.22_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.23_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/15.3_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/15.4_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/15.5_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/15.6_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/15.7_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/15.8_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/15.9_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/16.1_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/16.10_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/16.11_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/16.12_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/16.13_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/16.14_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/16.15_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/16.2_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/16.3_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/16.4_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/16.5_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/16.6_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/16.7_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/16.8_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/16.9_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/17.1_COR FLAIR RECON_77.jpg  
  inflating: /home/ubuntu/data/Controltest/17.10_COR FLAIR RECON_118.jpg  
  inflating: /home/ubuntu/data/Controltest/17.11_COR FLAIR RECON_122.jpg  
  inflating: /home/ubuntu/data/Controltest/17.12_COR FLAIR RECON_126.jpg  
  inflating: /home/ubuntu/data/Controltest/17.13_COR FLAIR RECON_130.jpg  
  inflating: /home/ubuntu/data/Controltest/17.14_COR FLAIR RECON_134.jpg  
  inflating: /home/ubuntu/data/Controltest/17.15_COR FLAIR RECON_138.jpg  
  inflating: /home/ubuntu/data/Controltest/17.16_COR FLAIR RECON_142.jpg  
  inflating: /home/ubuntu/data/Controltest/17.17_AX FLAIR RECON_100.jpg  
  inflating: /home/ubuntu/data/Controltest/17.18_AX FLAIR RECON_104.jpg  
  inflating: /home/ubuntu/data/Controltest/17.19_AX FLAIR RECON_107.jpg  
  inflating: /home/ubuntu/data/Controltest/17.2_COR FLAIR RECON_82.jpg  
  inflating: /home/ubuntu/data/Controltest/17.20_AX FLAIR RECON_111.jpg  
  inflating: /home/ubuntu/data/Controltest/17.21_AX FLAIR RECON_116.jpg  
  inflating: /home/ubuntu/data/Controltest/17.22_AX FLAIR RECON_120.jpg  
  inflating: /home/ubuntu/data/Controltest/17.23_AX FLAIR RECON_124.jpg  
  inflating: /home/ubuntu/data/Controltest/17.24_AX FLAIR RECON_127.jpg  
  inflating: /home/ubuntu/data/Controltest/17.25_AX FLAIR RECON_130.jpg  
  inflating: /home/ubuntu/data/Controltest/17.26_AX FLAIR RECON_133.jpg  
  inflating: /home/ubuntu/data/Controltest/17.27_AX FLAIR RECON_136.jpg  
  inflating: /home/ubuntu/data/Controltest/17.28_AX FLAIR RECON_138.jpg  
  inflating: /home/ubuntu/data/Controltest/17.29_AX FLAIR RECON_141.jpg  
  inflating: /home/ubuntu/data/Controltest/17.3_COR FLAIR RECON_87.jpg  
  inflating: /home/ubuntu/data/Controltest/17.30_AX FLAIR RECON_144.jpg  
  inflating: /home/ubuntu/data/Controltest/17.31_AXIAL MPRAGE_100.jpg  
  inflating: /home/ubuntu/data/Controltest/17.32_AXIAL MPRAGE_106.jpg  
  inflating: /home/ubuntu/data/Controltest/17.33_AXIAL MPRAGE_113.jpg  
  inflating: /home/ubuntu/data/Controltest/17.34_SAGITTAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/17.35_SAGITTAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/17.36_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/17.37_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/17.38_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/17.39_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/17.4_COR FLAIR RECON_91.jpg  
  inflating: /home/ubuntu/data/Controltest/17.40_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/17.41_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/17.42_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/17.43_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/17.44_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/17.45_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/17.5_COR FLAIR RECON_96.jpg  
  inflating: /home/ubuntu/data/Controltest/17.6_COR FLAIR RECON_100.jpg  
  inflating: /home/ubuntu/data/Controltest/17.7_COR FLAIR RECON_105.jpg  
  inflating: /home/ubuntu/data/Controltest/17.8_COR FLAIR RECON_109.jpg  
  inflating: /home/ubuntu/data/Controltest/17.9_COR FLAIR RECON_114.jpg  
  inflating: /home/ubuntu/data/Controltest/2.1_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/2.10_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/2.11_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/2.12_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/2.13_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/2.14_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/2.15_COR 4.2 FLAIR RECON_20.jpg  
  inflating: /home/ubuntu/data/Controltest/2.16_COR 4.2 FLAIR RECON_23.jpg  
  inflating: /home/ubuntu/data/Controltest/2.17_COR 4.2 FLAIR RECON_27.jpg  
  inflating: /home/ubuntu/data/Controltest/2.18_COR 4.2 FLAIR RECON_31.jpg  
  inflating: /home/ubuntu/data/Controltest/2.19_COR 4.2 FLAIR RECON_35.jpg  
  inflating: /home/ubuntu/data/Controltest/2.2_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/2.3_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/2.4_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/2.5_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/2.6_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/2.7_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/2.8_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/2.9_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/3.1_COR FLAIR SPC RECON_120.jpg  
  inflating: /home/ubuntu/data/Controltest/3.10_COR MPRAGE RECON_122.jpg  
  inflating: /home/ubuntu/data/Controltest/3.11_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/3.12_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/3.13_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/3.14_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/3.15_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/3.16_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/3.17_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/3.18_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/3.2_COR FLAIR SPC RECON_132.jpg  
  inflating: /home/ubuntu/data/Controltest/3.3_COR FLAIR SPC RECON_139.jpg  
  inflating: /home/ubuntu/data/Controltest/3.4_COR FLAIR SPC RECON_148.jpg  
  inflating: /home/ubuntu/data/Controltest/3.5_COR FLAIR SPC RECON_158.jpg  
  inflating: /home/ubuntu/data/Controltest/3.6_COR MPRAGE RECON_90.jpg  
  inflating: /home/ubuntu/data/Controltest/3.7_COR MPRAGE RECON_96.jpg  
  inflating: /home/ubuntu/data/Controltest/3.8_COR MPRAGE RECON_105.jpg  
  inflating: /home/ubuntu/data/Controltest/3.9_COR MPRAGE RECON_114.jpg  
  inflating: /home/ubuntu/data/Controltest/4.1_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/4.10_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/4.11_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/4.12_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/4.13_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/4.2_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/4.3_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/4.4_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/4.7_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/4.8_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/4.9_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/5.1_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/5.2_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/5.3_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/5.4_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/5.5_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/5.6_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/5.7_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/5.8_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/6.1_AXIAL FLAIR SPACE RECON_110.jpg  
  inflating: /home/ubuntu/data/Controltest/6.10_AXIAL FLAIR SPACE RECON_158.jpg  
  inflating: /home/ubuntu/data/Controltest/6.11_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/6.12_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/6.13_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/6.14_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/6.15_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/6.16_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/6.17_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/6.18_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/6.2_AXIAL FLAIR SPACE RECON_114.jpg  
  inflating: /home/ubuntu/data/Controltest/6.3_AXIAL FLAIR SPACE RECON_124.jpg  
  inflating: /home/ubuntu/data/Controltest/6.4_AXIAL FLAIR SPACE RECON_132.jpg  
  inflating: /home/ubuntu/data/Controltest/6.5_AXIAL FLAIR SPACE RECON_140.jpg  
  inflating: /home/ubuntu/data/Controltest/6.6_AXIAL FLAIR SPACE RECON_144.jpg  
  inflating: /home/ubuntu/data/Controltest/6.7_AXIAL FLAIR SPACE RECON_147.jpg  
  inflating: /home/ubuntu/data/Controltest/6.8_AXIAL FLAIR SPACE RECON_151.jpg  
  inflating: /home/ubuntu/data/Controltest/6.9_AXIAL FLAIR SPACE RECON_154.jpg  
  inflating: /home/ubuntu/data/Controltest/7.1_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/7.10_COR FLAIR SPC RECON_160.jpg  
  inflating: /home/ubuntu/data/Controltest/7.2_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/7.3_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/7.4_AXIAL_TSE.jpg  
  inflating: /home/ubuntu/data/Controltest/7.5_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/7.6_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/7.7_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/7.8_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/7.9_COR FLAIR SPC RECON_123.jpg  
  inflating: /home/ubuntu/data/Controltest/8.1_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.10_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/8.11_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/8.12_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/8.13_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/8.14_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/8.15_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/8.16_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.17_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.18_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.19_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.2_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.20_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.21_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.22_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.23_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.24_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.25_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.26_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/8.27_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/8.28_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/8.29_SAGITTAL_MPRAGE.jpg  
  inflating: /home/ubuntu/data/Controltest/8.3_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.4_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.5_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.6_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.7_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.8_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/8.9_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.1_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.10_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/9.11_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/9.12_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/9.13_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/9.14_AXIAL_FLAIR.jpg  
  inflating: /home/ubuntu/data/Controltest/9.15_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.16_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.17_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.18_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.19_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.2_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.20_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.21_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.22_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.23_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.24_CORONAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.3_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.4_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.5_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.6_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.7_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.8_AXIAL_T2.jpg  
  inflating: /home/ubuntu/data/Controltest/9.9_AXIAL_FLAIR.jpg  
Archive:  /home/ubuntu/data/PVNHtest.zip
  inflating: /home/ubuntu/data/PVNHtest/1.1_AX T2_35.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.10_AX T2_47.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.100_COR MPRAGE RECONST_115.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.101_COR MPRAGE RECONST_116.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.102_COR MPRAGE RECONST_117.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.103_COR MPRAGE RECONST_118.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.104_COR MPRAGE RECONST_119.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.105_COR MPRAGE RECONST_120.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.106_COR MPRAGE RECONST_121.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.107_COR MPRAGE RECONST_122.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.108_COR MPRAGE RECONST_123.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.109_COR MPRAGE RECONST_124.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.11_AXT2FLAIR_26.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.110_COR MPRAGE RECONST_125.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.111_COR MPRAGE RECONST_126.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.12_AXT2FLAIR_28.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.13_AXT2FLAIR_29.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.14_AXT2FLAIR_30.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.15_COR T2_26.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.16_COR T2_28.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.17_COR T2_30.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.18_COR T2_32.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.19_COR T2_34.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.2_AX T2_39.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.20_COR T2_36.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.21_COR MPRAGE RECONST_72.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.22_COR MPRAGE RECONST_75.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.23_COR MPRAGE RECONST_78.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.24_COR MPRAGE RECONST_81.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.25_COR MPRAGE RECONST_84.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.26_COR MPRAGE RECONST_87.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.27_COR MPRAGE RECONST_90.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.28_COR MPRAGE RECONST_93.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.29_COR MPRAGE RECONST_96.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.3_AX T2_40.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.30_COR MPRAGE RECONST_99.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.31_COR MPRAGE RECONST_102.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.32_COR MPRAGE RECONST_105.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.33_AXIAL MPRAGE RECONS_100.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.34_AXIAL MPRAGE RECONS_103.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.35_AXIAL MPRAGE RECONS_106.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.36_AXIAL MPRAGE RECONS_109.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.37_AXIAL MPRAGE RECONS_112.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.38_AXIAL MPRAGE RECONS_115.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.39_AXIAL MPRAGE RECONS_91.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.4_AX T2_41.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.40_AXIAL MPRAGE RECONS_92.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.41_AXIAL MPRAGE RECONS_93.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.42_AXIAL MPRAGE RECONS_94.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.43_AXIAL MPRAGE RECONS_95.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.44_AXIAL MPRAGE RECONS_96.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.45_AXIAL MPRAGE RECONS_97.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.46_AXIAL MPRAGE RECONS_98.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.47_AXIAL MPRAGE RECONS_99.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.48_AXIAL MPRAGE RECONS_101.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.49_AXIAL MPRAGE RECONS_102.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.5_AX T2_42.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.50_AXIAL MPRAGE RECONS_104.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.51_AXIAL MPRAGE RECONS_105.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.52_AXIAL MPRAGE RECONS_107.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.53_AXIAL MPRAGE RECONS_108.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.54_AXIAL MPRAGE RECONS_110.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.55_AXIAL MPRAGE RECONS_111.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.56_AXIAL MPRAGE RECONS_113.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.57_AXIAL MPRAGE RECONS_114.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.58_AXIAL MPRAGE RECONS_116.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.59_AXIAL MPRAGE RECONS_117.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.6_AX T2_43.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.60_COR MPRAGE RECONST_63.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.61_COR MPRAGE RECONST_64.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.62_COR MPRAGE RECONST_65.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.63_COR MPRAGE RECONST_66.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.64_COR MPRAGE RECONST_67.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.65_COR MPRAGE RECONST_68.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.66_COR MPRAGE RECONST_69.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.67_COR MPRAGE RECONST_70.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.68_COR MPRAGE RECONST_71.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.69_COR MPRAGE RECONST_73.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.7_AX T2_44.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.70_COR MPRAGE RECONST_74.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.71_COR MPRAGE RECONST_76.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.72_COR MPRAGE RECONST_77.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.73_COR MPRAGE RECONST_79.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.74_COR MPRAGE RECONST_80.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.75_COR MPRAGE RECONST_82.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.76_COR MPRAGE RECONST_83.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.77_COR MPRAGE RECONST_85.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.78_COR MPRAGE RECONST_86.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.79_COR MPRAGE RECONST_88.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.8_AX T2_45.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.80_COR MPRAGE RECONST_89.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.81_COR MPRAGE RECONST_91.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.82_COR MPRAGE RECONST_92.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.83_COR MPRAGE RECONST_94.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.84_COR MPRAGE RECONST_95.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.85_COR MPRAGE RECONST_97.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.86_COR MPRAGE RECONST_98.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.87_COR MPRAGE RECONST_100.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.88_COR MPRAGE RECONST_101.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.89_COR MPRAGE RECONST_103.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.9_AX T2_46.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.90_COR MPRAGE RECONST_104.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.91_COR MPRAGE RECONST_106.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.92_COR MPRAGE RECONST_107.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.93_COR MPRAGE RECONST_108.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.94_COR MPRAGE RECONST_109.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.95_COR MPRAGE RECONST_110.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.96_COR MPRAGE RECONST_111.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.97_COR MPRAGE RECONST_112.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.98_COR MPRAGE RECONST_113.jpg  
  inflating: /home/ubuntu/data/PVNHtest/1.99_COR MPRAGE RECONST_114.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.1_AX FSE T2_39.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.10__MPR Range__95_94.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.11__MPR Range[1]__71_70.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.12__MPR Range[1]__77_76.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.13__MPR Range[1]__84_83.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.14_AX T2 FLAIR_25.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.15_AX T2 FLAIR_26.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.2_AX FSE T2_40.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.3_AX FSE T2_41.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.4_COR T2_34.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.5_COR T2_36.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.6_COR T2_41.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.7__MPR Range__92_91.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.8__MPR Range__93_92.jpg  
  inflating: /home/ubuntu/data/PVNHtest/2.9__MPR Range__94_93.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.1_AX TSE T2_31.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.10_AX MPRAGE RECON_107.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.11_AX MPRAGE RECON_108.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.12_COR MPRAGE RECON_74.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.13_COR MPRAGE RECON_76.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.14_COR MPRAGE RECON_78.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.15_COR MPRAGE RECON_80.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.2_AX TSE T2_32.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.3_COR FSE T2_30.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.4_COR FSE T2_31.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.5_COR FSE T2_32.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.6_COR FSE T2_33.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.7_AX MPRAGE RECON_104.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.8_AX MPRAGE RECON_105.jpg  
  inflating: /home/ubuntu/data/PVNHtest/3.9_AX MPRAGE RECON_106.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.1_AX TSE T2_26.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.10__MPR Range[1]__70_69.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.11__MPR Range[1]__72_71.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.12__MPR Range[1]__74_73.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.13__MPR Range[1]__76_75.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.2_AX TSE T2_27.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.3_AX TSE T2_28.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.4__MPR Range__97_96.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.5__MPR Range__99_98.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.6__MPR Range__101_100.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.7__MPR Range__103_102.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.8__MPR Range[1]__66_65.jpg  
  inflating: /home/ubuntu/data/PVNHtest/4.9__MPR Range[1]__68_67.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.1_AX TSE T2_39.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.10_COR T1 RECON_119.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.11_COR T1 RECON_121.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.2_AX TSE T2_40.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.3_AX TSE T2_41.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.4_AX TSE T2_42.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.5_AX T2 FLAIR FS_26.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.6_AX T2 FLAIR FS_27.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.7_AX T1 RECON_102.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.8_AX T1 RECON_104.jpg  
  inflating: /home/ubuntu/data/PVNHtest/5.9_AX T1 RECON_106.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.1_AX T2_29.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.10_COR T2_29.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.11_AX MPR RECONS_99.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.12_AX MPR RECONS_101.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.13_AX MPR RECONS_103.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.14_COR MPR RECONS_58.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.15_COR MPR RECONS_61.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.16_COR MPR RECONS_64.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.17_COR MPR RECONS_67.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.18_COR MPR RECONS_70.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.19_COR MPR RECONS_73.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.2_AX T2_30.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.20_COR MPR RECONS_76.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.21_COR MPR RECONS_79.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.3_AX T2_31.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.4_AX T2 FLAIR FS_19.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.5_AX T2 FLAIR FS_19.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.6_COR T2_21.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.7_COR T2_23.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.8_COR T2_25.jpg  
  inflating: /home/ubuntu/data/PVNHtest/6.9_COR T2_27.jpg  

Paths to original and processed images

In [4]:
# Path to the folder with the original images
pathtoimagesControltest = './data/Controltest/'

pathtoimagesPVNHtest = './data/PVNHtest/'


# Create directories to save the processed images
! mkdir ~/data/processedControltest 

! mkdir ~/data/processedPVNHtest 


# Path to the folder with the processed images
pathtoprocessedimagesControltest = './data/processedControltest/'

pathtoprocessedimagesPVNHtest = './data/processedPVNHtest/'

Read in and preprocess Controltest images

In [5]:
# Define the image size
image_size = (512, 512)

# Read in the training images
Controltest_dir = pathtoimagesControltest
Controltest_files = os.listdir(Controltest_dir)
# For each image
for f in Controltest_files:
    # Open the image
    img = Image.open(Controltest_dir + f)
    # Resize the image so that it has a size 512x512
    img = img.resize(image_size)
    # Transform into a numpy array with no page number and save it into the preprocessed folder
    img_arr = np.array(img)
    img_arr[462:512, 0:100, :] = np.mean(img_arr[452:462, 0:100, :])
    processed_img = Image.fromarray(img_arr, 'RGB')
    processed_img_name = './data/processedControltest/'+'processed'+str(np.random.randint(low=1, high=1e8))+ \
    str(np.random.randint(low=1e4, high=1e6))+str(np.random.randint(low=1e4, high=1e6))+ \
    str(np.random.randint(low=1e4, high=1e6))+str(np.random.randint(low=1e5, high=1e8))+ \
    str(np.random.randint(low=1e2, high=1e7))+str(np.random.randint(low=1e3, high=1e5))+ \
    str(np.random.randint(low=1e2, high=1e8))+'.jpg'
    processed_img.save(processed_img_name)

Read in and preprocess PVNHtest images

In [6]:
# Define the image size
image_size = (512, 512)

# Read in the training images
PVNHtest_dir = pathtoimagesPVNHtest
PVNHtest_files = os.listdir(PVNHtest_dir)
# For each image
for f in PVNHtest_files:
    # Open the image
    img = Image.open(PVNHtest_dir + f)
    # Resize the image so that it has a size 512x512
    img = img.resize(image_size)
    # Transform into a numpy array with no page number and save it into the preprocessed folder
    img_arr = np.array(img)
    img_arr[462:512, 0:100, :] = np.mean(img_arr[452:462, 0:100, :])
    processed_img = Image.fromarray(img_arr, 'RGB')
    processed_img_name = './data/processedPVNHtest/'+'processed'+str(np.random.randint(low=1, high=1e8))+ \
    str(np.random.randint(low=1e4, high=1e6))+str(np.random.randint(low=1e4, high=1e6))+ \
    str(np.random.randint(low=1e4, high=1e6))+str(np.random.randint(low=1e5, high=1e8))+ \
    str(np.random.randint(low=1e2, high=1e7))+str(np.random.randint(low=1e3, high=1e5))+ \
    str(np.random.randint(low=1e2, high=1e8))+'.jpg'
    processed_img.save(processed_img_name)  

SECOND PART: IMPORTATION OF FINAL DATA

Path to the final images

In [7]:
# Create directories for the final images
!mkdir ~/data/FinalControltest 

!mkdir ~/data/FinalPVNHtest 
In [8]:
# Copy all processed images to the final folders
!cp ./data/processedControltest/* ./data/FinalControltest/

!cp ./data/processedPVNHtest/* ./data/FinalPVNHtest/
In [9]:
## Path to final images
pathtofinalControltest = './data/FinalControltest/'

pathtofinalPVNHtest = './data/FinalPVNHtest/'

Import images and labels for the test set

In [10]:
## CONTROLS

# Define the image size
image_size = (512, 512)

# Read in the test images for controls
Controltest_images = []
Controltest_dir = pathtofinalControltest
Controltest_files = os.listdir(Controltest_dir)
# For each image
for f in Controltest_files:
    # Open the image
    img = Image.open(Controltest_dir + f)
    # Resize the image so that it has a size 512x512
    img = img.resize(image_size)
    # Transform into a numpy array
    img_arr = np.array(img)
    # Add the image to the array of images      
    Controltest_images.append(img_arr)

# After having transformed all images, transform the list into a numpy array  
Controltest_X = np.array(Controltest_images)

# Create an array of labels (0 for controls)
Controltest_y = np.array([[0]*Controltest_X.shape[0]]).T




## PVNH

# Read in the test images for PVNH
PVNHtest_images = []
PVNHtest_dir = pathtofinalPVNHtest
PVNHtest_files = os.listdir(PVNHtest_dir)
# For each image
for f in PVNHtest_files:
    # Open the image
    img = Image.open(PVNHtest_dir + f)
    # Resize the image so that it has a size 512x512
    img = img.resize(image_size)
    # Transform into a numpy array
    img_arr = np.array(img)
    # Add the image to the array of images      
    PVNHtest_images.append(img_arr)

# After having transformed all images, transform the list into a numpy array  
PVNHtest_X = np.array(PVNHtest_images)

# Create an array of labels (2 for PVNH)
PVNHtest_y = np.array([[1]*PVNHtest_X.shape[0]]).T




## MERGE CONTROLS AND PVNH

# Train merge files
test_X = np.concatenate([Controltest_X, PVNHtest_X])
test_y = np.vstack((Controltest_y, PVNHtest_y))

# GPU expects values to be 32-bit floats
test_X = test_X.astype(np.float32)

# Rescale the pixel values to be between 0 and 1
test_X /= 255.
In [11]:
# Shuffle in unison the test_X and the test_y array (123 is just a random number for reproducibility)
shuffled_test_X, shuffled_test_y = shuffle(test_X, test_y, random_state=123)

# Transform outcome to one-hot encoding
shuffled_test_y = to_categorical(shuffled_test_y)
In [12]:
# Make sure that the dimensions are as expected
shuffled_test_X.shape
Out[12]:
(524, 512, 512, 3)
In [13]:
# Example of an image to make sure they were converted right
plt.imshow(shuffled_test_X[0])
plt.grid(b=None)
plt.xticks([])
plt.yticks([])
plt.show()
In [14]:
# Make sure that the dimensions are as expected
shuffled_test_y.shape
Out[14]:
(524, 2)
In [15]:
# Make sure that the label is correct for the image
shuffled_test_y[0]
Out[15]:
array([1., 0.], dtype=float32)

THIRD PART: EVALUATE THE NEURAL NETWORK

Load the model

In [16]:
# load model
json_file = open('InceptionResNetV2.json', 'r')
loaded_model_json = json_file.read()
json_file.close()
model = model_from_json(loaded_model_json)
# load weights into new model
model.load_weights("InceptionResNetV2.h5")

Compile the model

In [17]:
# Compile model
model.compile(optimizer = Adam(lr = 0.0001), loss = 'categorical_crossentropy', metrics = ['accuracy'])

Evaluate the model

In [18]:
# Generate predictions in the form of probabilities for the test set
testInceptionResNetV2 = model.predict(shuffled_test_X, batch_size = 32)

# Generate the confusion matrix in the test set
y_true = np.argmax(shuffled_test_y, axis=1)
y_predInceptionResNetV2 = np.argmax(testInceptionResNetV2, axis=1)

# Confusion matrix
pd.DataFrame(confusion_matrix(y_true, y_predInceptionResNetV2), index=['True: Normal', 'True: PVNH'], columns=['Prediction: Normal', 'Prediction: PVNH']).T
Out[18]:
True: Normal True: PVNH
Prediction: Normal 280 26
Prediction: PVNH 58 160
In [19]:
# Calculate accuracy in the test set
accuracy_InceptionResNetV2 = accuracy_score(y_true=y_true, y_pred=y_predInceptionResNetV2)
print('The accuracy in the test set is {:.4f}.'.format(accuracy_InceptionResNetV2))
The accuracy in the test set is 0.8397.
In [20]:
# Calculate AUC in the test set
auc_validInceptionResNetV2 = roc_auc_score(shuffled_test_y, model.predict(shuffled_test_X))
print('The AUC in the test set is {:.4f}.'.format(auc_validInceptionResNetV2))
The AUC in the test set is 0.8998.
In [21]:
# Classification report
print(classification_report(y_true, y_predInceptionResNetV2, target_names=['Normal MRI', 'PVNH']))
              precision    recall  f1-score   support

  Normal MRI       0.92      0.83      0.87       338
        PVNH       0.73      0.86      0.79       186

    accuracy                           0.84       524
   macro avg       0.82      0.84      0.83       524
weighted avg       0.85      0.84      0.84       524

Model visualization

In [22]:
# Visualize the structure and layers of the model
model.layers
Out[22]:
[<tensorflow.python.keras.engine.input_layer.InputLayer at 0x7f9e38258e48>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9d6b5822b0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38265748>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38265b00>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38265cc0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38265ef0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3821c0f0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3821c2b0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3821c4e0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3821c6a0>,
 <tensorflow.python.keras.layers.pooling.MaxPooling2D at 0x7f9e3821c8d0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3821ca58>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3821cc88>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3821ce48>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e382280b8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e382282e8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e382284e0>,
 <tensorflow.python.keras.layers.pooling.MaxPooling2D at 0x7f9e38228710>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38228898>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38228ac8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38228c88>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38228eb8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38231128>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38231358>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38231550>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38231898>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38231ac8>,
 <tensorflow.python.keras.layers.pooling.AveragePooling2D at 0x7f9e38231ba8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38231d30>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38231f60>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381bd1d0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381bd400>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381bd630>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381bd7f0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381bdb38>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381bde80>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381c7208>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381c7438>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381c7518>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381c75f8>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e381c76d8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381c78d0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381c7ac8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381c7cc0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381c7ef0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381d2160>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381d2390>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381d2588>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381d28d0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381d2b00>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381d2be0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381d2e10>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381da080>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381da2b0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381da4a8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381da7f0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381dab38>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381dad68>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381dae48>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e381daf28>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381e5048>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e44e42ac8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381e5588>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381e5828>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381e5a58>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381e5c18>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381e5e48>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381f10b8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381f12e8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381f14e0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381f1828>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381f1a58>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381f1b38>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381f1d68>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381f1f98>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3817d208>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3817d400>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3817d748>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3817da90>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3817dcc0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3817dda0>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e3817de80>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3817df60>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e38182240>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38182358>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38182470>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381826a0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38182860>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38182a90>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38182cc0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38182ef0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38193128>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38193470>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381936a0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38193780>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381939b0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38193be0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38193e10>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3819e048>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3819e390>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3819e6d8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3819e908>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3819e9e8>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e3819eac8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3819eba8>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e3819ee48>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3819ef60>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381a70b8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381a72e8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381a74a8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381a76d8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381a7908>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381a7b38>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381a7d30>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381b20b8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381b22e8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381b23c8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381b25f8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381b2828>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381b2a58>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381b2c50>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381b2f98>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3813e320>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3813e550>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3813e630>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e3813e710>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3813e7f0>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e3813ea90>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3813eba8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3813ecc0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3813eef0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381490f0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38149320>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38149550>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38149780>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38149978>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38149cc0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38149ef0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38149fd0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38151240>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38151470>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381516a0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38151898>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38151be0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38151f28>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3815d198>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3815d278>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e3815d358>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3815d438>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e3815d6d8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3815d7f0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3815d908>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3815db38>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3815dcf8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3815df28>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38169198>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381693c8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381695c0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38169908>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38169b38>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38169c18>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38169e48>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381720b8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381722e8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381724e0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38172828>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38172b70>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38172da0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38172e80>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e38172f60>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380fc080>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e380fc320>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380fc438>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380fc550>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380fc780>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380fc940>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380fcb70>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380fcda0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380fcfd0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38109208>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38109550>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38109780>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38109860>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38109a90>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38109cc0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38109ef0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38115128>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38115470>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381157b8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e381159e8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38115ac8>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e38115ba8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38115c88>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e38115f28>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3811b080>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3811b198>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3811b3c8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3811b588>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3811b7b8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3811b9e8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3811bc18>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3811be10>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3812c198>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3812c3c8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3812c4a8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3812c6d8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3812c908>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3812cb38>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3812cd30>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e381350b8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38135400>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38135630>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38135710>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e381357f0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e381358d0>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e38135b70>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38135c88>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38135da0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38135fd0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380bd1d0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380bd400>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380bd630>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380bd860>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380bda58>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380bdda0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380bdfd0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380cb0f0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380cb320>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380cb550>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380cb780>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380cb978>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380cbcc0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380d7048>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380d7278>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380d7358>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e380d7438>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380d7518>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e380d77b8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380d78d0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380d79e8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380d7c18>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380d7dd8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380e1048>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380e1278>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380e14a8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380e16a0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380e19e8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380e1c18>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380e1cf8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380e1f28>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380ed198>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380ed3c8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380ed5c0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380ed908>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380edc50>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380ede80>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380edf60>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e380f5080>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380f5160>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e380f5400>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380f5518>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380f5630>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380f5860>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380f5a20>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380f5c50>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380f5e80>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380820b8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380822e8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38082518>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38082748>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38082940>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38082c88>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38082eb8>,
 <tensorflow.python.keras.layers.pooling.MaxPooling2D at 0x7f9e38082f98>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e3808f160>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3808f240>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3808f4e0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3808f6a0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3808f8d0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3808fb00>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3808fcf8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3808ff28>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38098198>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380983c8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380985c0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38098908>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38098b38>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e38098c18>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38098cf8>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e38098f60>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380a40b8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380a41d0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380a4400>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380a45c0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380a47f0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380a4a20>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380a4c18>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380a4e48>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380af0b8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380af2e8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380af4e0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380af828>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380afa58>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e380afb38>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380afc18>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e380afe80>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380aff98>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380b60f0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380b6320>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380b64e0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380b6710>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380b6940>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380b6b38>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380b6d68>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380b6f98>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38043208>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38043400>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38043748>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38043978>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e38043a58>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38043b38>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e38043da0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38043eb8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38043fd0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38051240>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38051400>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38051630>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38051860>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38051a58>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38051c88>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38051eb8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38059128>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38059320>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38059668>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38059898>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e38059978>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38059a58>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e38059cc0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38059dd8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38059ef0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38064160>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38064320>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38064550>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38064780>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38064978>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38064ba8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38064dd8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38070048>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38070240>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38070588>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380707b8>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e38070898>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38070978>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e38070be0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38070cf8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38070e10>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3807b080>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3807b240>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3807b470>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3807b6a0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3807b898>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3807bac8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3807bcf8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3807bf28>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38006160>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380064a8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380066d8>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e380067b8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38006898>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e38006b00>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38006c18>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38006d30>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38006f60>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3800d160>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3800d390>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3800d5c0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3800d7b8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3800d9e8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3800dc18>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3800de48>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3801e080>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3801e3c8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3801e5f8>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e3801e6d8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3801e7b8>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e3801ea20>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e3801eb38>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e3801ec50>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e3801ee80>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38028080>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380282b0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e380284e0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380286d8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38028908>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38028b38>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38028d68>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38028f60>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e380332e8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38033518>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e380335f8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e380336d8>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e38033940>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38033a58>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e38033b70>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e38033da0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e38033f60>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fbf1d0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fbf400>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fbf5f8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fbf828>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fbfa58>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fbfc88>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fbfe80>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fc7208>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fc7438>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31fc7518>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fc75f8>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31fc7860>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fc7978>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fc7a90>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fc7cc0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fc7e80>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fd50f0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fd5320>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fd5518>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fd5748>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fd5978>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fd5ba8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fd5da0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fe0128>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fe0358>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31fe0438>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fe0518>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31fe0780>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fe0898>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fe09b0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fe0be0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fe0da0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fe0fd0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fe9240>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fe9438>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fe9668>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fe9898>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fe9ac8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fe9cc0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ff4048>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ff4278>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31ff4358>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ff4438>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31ff46a0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ff47b8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ff48d0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ff4b00>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ff4cc0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ff4ef0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f7f160>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f7f358>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f7f588>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f7f7b8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f7f9e8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f7fbe0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f7ff28>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f8b198>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31f8b278>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f8b358>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31f8b5c0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f8b6d8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f8b7f0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f8ba20>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f8bbe0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f8be10>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f93080>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f93278>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f934a8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f936d8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f93908>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f93b00>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f93e48>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fa20b8>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31fa2198>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fa2278>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31fa24e0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fa25f8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fa2710>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fa2940>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fa2b00>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fa2d30>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fa2f60>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fad198>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fad3c8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fad5f8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fad828>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fada20>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fadd68>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fadf98>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31fb60b8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fb6198>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31fb6400>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fb6518>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fb6630>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fb6860>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31fb6a20>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31fb6c50>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31fb6e80>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f430b8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f432e8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f43518>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f43748>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f43940>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f43c88>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f43eb8>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31f43f98>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f4e0b8>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31f4e320>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f4e438>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f4e550>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f4e780>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f4e940>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f4eb70>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f4eda0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f4ef98>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f54208>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f54438>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f54668>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f54860>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f54ba8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f54dd8>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31f54eb8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f54f98>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31f5f240>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f5f358>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f5f470>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f5f6a0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f5f860>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f5fa90>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f5fcc0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f5feb8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f70128>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f70358>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f70588>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f70780>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f70ac8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f70cf8>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31f70dd8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f70eb8>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31f78160>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f78278>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f78390>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f785c0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f78780>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f789b0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f78be0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f78dd8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31eff048>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31eff278>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31eff4a8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31eff6a0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31eff9e8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31effc18>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31effcf8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31effdd8>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31f0e080>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f0e198>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f0e2b0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f0e4e0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f0e6a0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f0e8d0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f0eb00>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f0ecf8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f0ef28>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f19198>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f193c8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f195c0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f19908>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f19b38>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31f19c18>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f19cf8>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31f19f60>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f250b8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f251d0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f25400>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f255c0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f257f0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f25a20>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f25c18>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f25e48>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f310b8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f312e8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f314e0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f31828>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f31a58>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31f31b38>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f31c18>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31f31e80>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f31f98>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f3a0f0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f3a320>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31f3a4e0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f3a710>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f3a940>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31f3ab70>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f3ada0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31f3af98>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ec6320>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ec6668>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ec6898>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ec6978>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ec6a58>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ec6c88>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ec6eb8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ed2128>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ed2320>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ed2668>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ed29b0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ed2be0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ed2cc0>,
 <tensorflow.python.keras.layers.pooling.MaxPooling2D at 0x7f9e31ed2da0>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31ed2f28>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31edd160>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31edd358>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31edd518>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31edd748>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31edd978>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31eddb70>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31eddda0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31eddfd0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ee5240>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ee5438>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ee5780>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ee59b0>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31ee5a90>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ee5b70>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31ee5dd8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ee5ef0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ef1048>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ef1278>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ef1438>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ef1668>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ef1898>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ef1a90>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ef1cc0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ef1ef0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e7c160>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e7c358>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e7c6a0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e7c8d0>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31e7c9b0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e7ca90>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31e7ccf8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e7ce10>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e7cf28>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e85198>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e85358>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e85588>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e857b8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e859b0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e85be0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e85e10>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e91080>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e91278>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e915c0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e917f0>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31e918d0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e919b0>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31e91c18>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e91d30>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e91e48>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e9a0b8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e9a278>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e9a4a8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e9a6d8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e9a8d0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e9ab00>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e9ad30>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e9af60>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ea8198>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ea84e0>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ea8710>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31ea87f0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ea88d0>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31ea8b38>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31ea8c50>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31ea8d68>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31ea8f98>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31eb3198>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31eb33c8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31eb35f8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31eb37f0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31eb3a20>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31eb3c50>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31eb3e80>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e400b8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e40400>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e40630>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31e40710>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e407f0>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31e40a58>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e40b70>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e40c88>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e40eb8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e4a0b8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e4a2e8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e4a518>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e4a710>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e4a940>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e4ab70>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e4ada0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e4af98>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e51320>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e51550>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31e51630>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e51710>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31e51978>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e51a90>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e51ba8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e51dd8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e51f98>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e60208>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e60438>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e60630>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e60860>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e60a90>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e60cc0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e60eb8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e6c240>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e6c470>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31e6c550>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e6c630>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31e6c898>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e6c9b0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e6cac8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e6ccf8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e6ceb8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e76128>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e76358>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e76550>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e76780>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e769b0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e76be0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e76dd8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e04160>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e04390>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31e04470>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e04550>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31e047b8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e048d0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e049e8>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e04c18>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e04dd8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e0d048>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e0d278>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e0d470>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e0d6a0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e0d8d0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e0db00>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e0dcf8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e19080>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e192b0>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31e19390>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e19470>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31e196d8>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e197f0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e19908>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e19b38>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e19cf8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e19f28>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e1d198>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e1d390>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e1d5c0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e1d7f0>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e1da20>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e1dc18>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e1df60>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e2d1d0>,
 <tensorflow.python.keras.layers.merge.Concatenate at 0x7f9e31e2d2b0>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e2d390>,
 <tensorflow.python.keras.layers.core.Lambda at 0x7f9e31e2d5f8>,
 <tensorflow.python.keras.layers.convolutional.Conv2D at 0x7f9e31e2d710>,
 <tensorflow.python.keras.layers.normalization.BatchNormalization at 0x7f9e31e2d978>,
 <tensorflow.python.keras.layers.core.Activation at 0x7f9e31e2db38>,
 <tensorflow.python.keras.layers.pooling.GlobalAveragePooling2D at 0x7f9e31e2dd68>,
 <tensorflow.python.keras.layers.core.Dense at 0x7f9e31e2de80>,
 <tensorflow.python.keras.layers.core.Dropout at 0x7f9e31e380b8>,
 <tensorflow.python.keras.layers.core.Dense at 0x7f9e31e38198>,
 <tensorflow.python.keras.layers.core.Dropout at 0x7f9e31e383c8>,
 <tensorflow.python.keras.layers.core.Dense at 0x7f9e31e384a8>,
 <tensorflow.python.keras.layers.core.Dense at 0x7f9e31e386d8>]
In [23]:
# Visualize the structure and layers of the model
print(model.summary())
Model: "model_123"
__________________________________________________________________________________________________
Layer (type)                    Output Shape         Param #     Connected to                     
==================================================================================================
input_4 (InputLayer)            [(None, 512, 512, 3) 0                                            
__________________________________________________________________________________________________
conv2d_129 (Conv2D)             (None, 255, 255, 32) 864         input_4[0][0]                    
__________________________________________________________________________________________________
batch_normalization_98 (BatchNo (None, 255, 255, 32) 96          conv2d_129[0][0]                 
__________________________________________________________________________________________________
activation_98 (Activation)      (None, 255, 255, 32) 0           batch_normalization_98[0][0]     
__________________________________________________________________________________________________
conv2d_130 (Conv2D)             (None, 253, 253, 32) 9216        activation_98[0][0]              
__________________________________________________________________________________________________
batch_normalization_99 (BatchNo (None, 253, 253, 32) 96          conv2d_130[0][0]                 
__________________________________________________________________________________________________
activation_99 (Activation)      (None, 253, 253, 32) 0           batch_normalization_99[0][0]     
__________________________________________________________________________________________________
conv2d_131 (Conv2D)             (None, 253, 253, 64) 18432       activation_99[0][0]              
__________________________________________________________________________________________________
batch_normalization_100 (BatchN (None, 253, 253, 64) 192         conv2d_131[0][0]                 
__________________________________________________________________________________________________
activation_100 (Activation)     (None, 253, 253, 64) 0           batch_normalization_100[0][0]    
__________________________________________________________________________________________________
max_pooling2d_14 (MaxPooling2D) (None, 126, 126, 64) 0           activation_100[0][0]             
__________________________________________________________________________________________________
conv2d_132 (Conv2D)             (None, 126, 126, 80) 5120        max_pooling2d_14[0][0]           
__________________________________________________________________________________________________
batch_normalization_101 (BatchN (None, 126, 126, 80) 240         conv2d_132[0][0]                 
__________________________________________________________________________________________________
activation_101 (Activation)     (None, 126, 126, 80) 0           batch_normalization_101[0][0]    
__________________________________________________________________________________________________
conv2d_133 (Conv2D)             (None, 124, 124, 192 138240      activation_101[0][0]             
__________________________________________________________________________________________________
batch_normalization_102 (BatchN (None, 124, 124, 192 576         conv2d_133[0][0]                 
__________________________________________________________________________________________________
activation_102 (Activation)     (None, 124, 124, 192 0           batch_normalization_102[0][0]    
__________________________________________________________________________________________________
max_pooling2d_15 (MaxPooling2D) (None, 61, 61, 192)  0           activation_102[0][0]             
__________________________________________________________________________________________________
conv2d_137 (Conv2D)             (None, 61, 61, 64)   12288       max_pooling2d_15[0][0]           
__________________________________________________________________________________________________
batch_normalization_106 (BatchN (None, 61, 61, 64)   192         conv2d_137[0][0]                 
__________________________________________________________________________________________________
activation_106 (Activation)     (None, 61, 61, 64)   0           batch_normalization_106[0][0]    
__________________________________________________________________________________________________
conv2d_135 (Conv2D)             (None, 61, 61, 48)   9216        max_pooling2d_15[0][0]           
__________________________________________________________________________________________________
conv2d_138 (Conv2D)             (None, 61, 61, 96)   55296       activation_106[0][0]             
__________________________________________________________________________________________________
batch_normalization_104 (BatchN (None, 61, 61, 48)   144         conv2d_135[0][0]                 
__________________________________________________________________________________________________
batch_normalization_107 (BatchN (None, 61, 61, 96)   288         conv2d_138[0][0]                 
__________________________________________________________________________________________________
activation_104 (Activation)     (None, 61, 61, 48)   0           batch_normalization_104[0][0]    
__________________________________________________________________________________________________
activation_107 (Activation)     (None, 61, 61, 96)   0           batch_normalization_107[0][0]    
__________________________________________________________________________________________________
average_pooling2d_9 (AveragePoo (None, 61, 61, 192)  0           max_pooling2d_15[0][0]           
__________________________________________________________________________________________________
conv2d_134 (Conv2D)             (None, 61, 61, 96)   18432       max_pooling2d_15[0][0]           
__________________________________________________________________________________________________
conv2d_136 (Conv2D)             (None, 61, 61, 64)   76800       activation_104[0][0]             
__________________________________________________________________________________________________
conv2d_139 (Conv2D)             (None, 61, 61, 96)   82944       activation_107[0][0]             
__________________________________________________________________________________________________
conv2d_140 (Conv2D)             (None, 61, 61, 64)   12288       average_pooling2d_9[0][0]        
__________________________________________________________________________________________________
batch_normalization_103 (BatchN (None, 61, 61, 96)   288         conv2d_134[0][0]                 
__________________________________________________________________________________________________
batch_normalization_105 (BatchN (None, 61, 61, 64)   192         conv2d_136[0][0]                 
__________________________________________________________________________________________________
batch_normalization_108 (BatchN (None, 61, 61, 96)   288         conv2d_139[0][0]                 
__________________________________________________________________________________________________
batch_normalization_109 (BatchN (None, 61, 61, 64)   192         conv2d_140[0][0]                 
__________________________________________________________________________________________________
activation_103 (Activation)     (None, 61, 61, 96)   0           batch_normalization_103[0][0]    
__________________________________________________________________________________________________
activation_105 (Activation)     (None, 61, 61, 64)   0           batch_normalization_105[0][0]    
__________________________________________________________________________________________________
activation_108 (Activation)     (None, 61, 61, 96)   0           batch_normalization_108[0][0]    
__________________________________________________________________________________________________
activation_109 (Activation)     (None, 61, 61, 64)   0           batch_normalization_109[0][0]    
__________________________________________________________________________________________________
mixed_5b (Concatenate)          (None, 61, 61, 320)  0           activation_103[0][0]             
                                                                 activation_105[0][0]             
                                                                 activation_108[0][0]             
                                                                 activation_109[0][0]             
__________________________________________________________________________________________________
conv2d_144 (Conv2D)             (None, 61, 61, 32)   10240       mixed_5b[0][0]                   
__________________________________________________________________________________________________
batch_normalization_113 (BatchN (None, 61, 61, 32)   96          conv2d_144[0][0]                 
__________________________________________________________________________________________________
activation_113 (Activation)     (None, 61, 61, 32)   0           batch_normalization_113[0][0]    
__________________________________________________________________________________________________
conv2d_142 (Conv2D)             (None, 61, 61, 32)   10240       mixed_5b[0][0]                   
__________________________________________________________________________________________________
conv2d_145 (Conv2D)             (None, 61, 61, 48)   13824       activation_113[0][0]             
__________________________________________________________________________________________________
batch_normalization_111 (BatchN (None, 61, 61, 32)   96          conv2d_142[0][0]                 
__________________________________________________________________________________________________
batch_normalization_114 (BatchN (None, 61, 61, 48)   144         conv2d_145[0][0]                 
__________________________________________________________________________________________________
activation_111 (Activation)     (None, 61, 61, 32)   0           batch_normalization_111[0][0]    
__________________________________________________________________________________________________
activation_114 (Activation)     (None, 61, 61, 48)   0           batch_normalization_114[0][0]    
__________________________________________________________________________________________________
conv2d_141 (Conv2D)             (None, 61, 61, 32)   10240       mixed_5b[0][0]                   
__________________________________________________________________________________________________
conv2d_143 (Conv2D)             (None, 61, 61, 32)   9216        activation_111[0][0]             
__________________________________________________________________________________________________
conv2d_146 (Conv2D)             (None, 61, 61, 64)   27648       activation_114[0][0]             
__________________________________________________________________________________________________
batch_normalization_110 (BatchN (None, 61, 61, 32)   96          conv2d_141[0][0]                 
__________________________________________________________________________________________________
batch_normalization_112 (BatchN (None, 61, 61, 32)   96          conv2d_143[0][0]                 
__________________________________________________________________________________________________
batch_normalization_115 (BatchN (None, 61, 61, 64)   192         conv2d_146[0][0]                 
__________________________________________________________________________________________________
activation_110 (Activation)     (None, 61, 61, 32)   0           batch_normalization_110[0][0]    
__________________________________________________________________________________________________
activation_112 (Activation)     (None, 61, 61, 32)   0           batch_normalization_112[0][0]    
__________________________________________________________________________________________________
activation_115 (Activation)     (None, 61, 61, 64)   0           batch_normalization_115[0][0]    
__________________________________________________________________________________________________
block35_1_mixed (Concatenate)   (None, 61, 61, 128)  0           activation_110[0][0]             
                                                                 activation_112[0][0]             
                                                                 activation_115[0][0]             
__________________________________________________________________________________________________
block35_1_conv (Conv2D)         (None, 61, 61, 320)  41280       block35_1_mixed[0][0]            
__________________________________________________________________________________________________
block35_1 (Lambda)              (None, 61, 61, 320)  0           mixed_5b[0][0]                   
                                                                 block35_1_conv[0][0]             
__________________________________________________________________________________________________
block35_1_ac (Activation)       (None, 61, 61, 320)  0           block35_1[0][0]                  
__________________________________________________________________________________________________
conv2d_150 (Conv2D)             (None, 61, 61, 32)   10240       block35_1_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_119 (BatchN (None, 61, 61, 32)   96          conv2d_150[0][0]                 
__________________________________________________________________________________________________
activation_119 (Activation)     (None, 61, 61, 32)   0           batch_normalization_119[0][0]    
__________________________________________________________________________________________________
conv2d_148 (Conv2D)             (None, 61, 61, 32)   10240       block35_1_ac[0][0]               
__________________________________________________________________________________________________
conv2d_151 (Conv2D)             (None, 61, 61, 48)   13824       activation_119[0][0]             
__________________________________________________________________________________________________
batch_normalization_117 (BatchN (None, 61, 61, 32)   96          conv2d_148[0][0]                 
__________________________________________________________________________________________________
batch_normalization_120 (BatchN (None, 61, 61, 48)   144         conv2d_151[0][0]                 
__________________________________________________________________________________________________
activation_117 (Activation)     (None, 61, 61, 32)   0           batch_normalization_117[0][0]    
__________________________________________________________________________________________________
activation_120 (Activation)     (None, 61, 61, 48)   0           batch_normalization_120[0][0]    
__________________________________________________________________________________________________
conv2d_147 (Conv2D)             (None, 61, 61, 32)   10240       block35_1_ac[0][0]               
__________________________________________________________________________________________________
conv2d_149 (Conv2D)             (None, 61, 61, 32)   9216        activation_117[0][0]             
__________________________________________________________________________________________________
conv2d_152 (Conv2D)             (None, 61, 61, 64)   27648       activation_120[0][0]             
__________________________________________________________________________________________________
batch_normalization_116 (BatchN (None, 61, 61, 32)   96          conv2d_147[0][0]                 
__________________________________________________________________________________________________
batch_normalization_118 (BatchN (None, 61, 61, 32)   96          conv2d_149[0][0]                 
__________________________________________________________________________________________________
batch_normalization_121 (BatchN (None, 61, 61, 64)   192         conv2d_152[0][0]                 
__________________________________________________________________________________________________
activation_116 (Activation)     (None, 61, 61, 32)   0           batch_normalization_116[0][0]    
__________________________________________________________________________________________________
activation_118 (Activation)     (None, 61, 61, 32)   0           batch_normalization_118[0][0]    
__________________________________________________________________________________________________
activation_121 (Activation)     (None, 61, 61, 64)   0           batch_normalization_121[0][0]    
__________________________________________________________________________________________________
block35_2_mixed (Concatenate)   (None, 61, 61, 128)  0           activation_116[0][0]             
                                                                 activation_118[0][0]             
                                                                 activation_121[0][0]             
__________________________________________________________________________________________________
block35_2_conv (Conv2D)         (None, 61, 61, 320)  41280       block35_2_mixed[0][0]            
__________________________________________________________________________________________________
block35_2 (Lambda)              (None, 61, 61, 320)  0           block35_1_ac[0][0]               
                                                                 block35_2_conv[0][0]             
__________________________________________________________________________________________________
block35_2_ac (Activation)       (None, 61, 61, 320)  0           block35_2[0][0]                  
__________________________________________________________________________________________________
conv2d_156 (Conv2D)             (None, 61, 61, 32)   10240       block35_2_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_125 (BatchN (None, 61, 61, 32)   96          conv2d_156[0][0]                 
__________________________________________________________________________________________________
activation_125 (Activation)     (None, 61, 61, 32)   0           batch_normalization_125[0][0]    
__________________________________________________________________________________________________
conv2d_154 (Conv2D)             (None, 61, 61, 32)   10240       block35_2_ac[0][0]               
__________________________________________________________________________________________________
conv2d_157 (Conv2D)             (None, 61, 61, 48)   13824       activation_125[0][0]             
__________________________________________________________________________________________________
batch_normalization_123 (BatchN (None, 61, 61, 32)   96          conv2d_154[0][0]                 
__________________________________________________________________________________________________
batch_normalization_126 (BatchN (None, 61, 61, 48)   144         conv2d_157[0][0]                 
__________________________________________________________________________________________________
activation_123 (Activation)     (None, 61, 61, 32)   0           batch_normalization_123[0][0]    
__________________________________________________________________________________________________
activation_126 (Activation)     (None, 61, 61, 48)   0           batch_normalization_126[0][0]    
__________________________________________________________________________________________________
conv2d_153 (Conv2D)             (None, 61, 61, 32)   10240       block35_2_ac[0][0]               
__________________________________________________________________________________________________
conv2d_155 (Conv2D)             (None, 61, 61, 32)   9216        activation_123[0][0]             
__________________________________________________________________________________________________
conv2d_158 (Conv2D)             (None, 61, 61, 64)   27648       activation_126[0][0]             
__________________________________________________________________________________________________
batch_normalization_122 (BatchN (None, 61, 61, 32)   96          conv2d_153[0][0]                 
__________________________________________________________________________________________________
batch_normalization_124 (BatchN (None, 61, 61, 32)   96          conv2d_155[0][0]                 
__________________________________________________________________________________________________
batch_normalization_127 (BatchN (None, 61, 61, 64)   192         conv2d_158[0][0]                 
__________________________________________________________________________________________________
activation_122 (Activation)     (None, 61, 61, 32)   0           batch_normalization_122[0][0]    
__________________________________________________________________________________________________
activation_124 (Activation)     (None, 61, 61, 32)   0           batch_normalization_124[0][0]    
__________________________________________________________________________________________________
activation_127 (Activation)     (None, 61, 61, 64)   0           batch_normalization_127[0][0]    
__________________________________________________________________________________________________
block35_3_mixed (Concatenate)   (None, 61, 61, 128)  0           activation_122[0][0]             
                                                                 activation_124[0][0]             
                                                                 activation_127[0][0]             
__________________________________________________________________________________________________
block35_3_conv (Conv2D)         (None, 61, 61, 320)  41280       block35_3_mixed[0][0]            
__________________________________________________________________________________________________
block35_3 (Lambda)              (None, 61, 61, 320)  0           block35_2_ac[0][0]               
                                                                 block35_3_conv[0][0]             
__________________________________________________________________________________________________
block35_3_ac (Activation)       (None, 61, 61, 320)  0           block35_3[0][0]                  
__________________________________________________________________________________________________
conv2d_162 (Conv2D)             (None, 61, 61, 32)   10240       block35_3_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_131 (BatchN (None, 61, 61, 32)   96          conv2d_162[0][0]                 
__________________________________________________________________________________________________
activation_131 (Activation)     (None, 61, 61, 32)   0           batch_normalization_131[0][0]    
__________________________________________________________________________________________________
conv2d_160 (Conv2D)             (None, 61, 61, 32)   10240       block35_3_ac[0][0]               
__________________________________________________________________________________________________
conv2d_163 (Conv2D)             (None, 61, 61, 48)   13824       activation_131[0][0]             
__________________________________________________________________________________________________
batch_normalization_129 (BatchN (None, 61, 61, 32)   96          conv2d_160[0][0]                 
__________________________________________________________________________________________________
batch_normalization_132 (BatchN (None, 61, 61, 48)   144         conv2d_163[0][0]                 
__________________________________________________________________________________________________
activation_129 (Activation)     (None, 61, 61, 32)   0           batch_normalization_129[0][0]    
__________________________________________________________________________________________________
activation_132 (Activation)     (None, 61, 61, 48)   0           batch_normalization_132[0][0]    
__________________________________________________________________________________________________
conv2d_159 (Conv2D)             (None, 61, 61, 32)   10240       block35_3_ac[0][0]               
__________________________________________________________________________________________________
conv2d_161 (Conv2D)             (None, 61, 61, 32)   9216        activation_129[0][0]             
__________________________________________________________________________________________________
conv2d_164 (Conv2D)             (None, 61, 61, 64)   27648       activation_132[0][0]             
__________________________________________________________________________________________________
batch_normalization_128 (BatchN (None, 61, 61, 32)   96          conv2d_159[0][0]                 
__________________________________________________________________________________________________
batch_normalization_130 (BatchN (None, 61, 61, 32)   96          conv2d_161[0][0]                 
__________________________________________________________________________________________________
batch_normalization_133 (BatchN (None, 61, 61, 64)   192         conv2d_164[0][0]                 
__________________________________________________________________________________________________
activation_128 (Activation)     (None, 61, 61, 32)   0           batch_normalization_128[0][0]    
__________________________________________________________________________________________________
activation_130 (Activation)     (None, 61, 61, 32)   0           batch_normalization_130[0][0]    
__________________________________________________________________________________________________
activation_133 (Activation)     (None, 61, 61, 64)   0           batch_normalization_133[0][0]    
__________________________________________________________________________________________________
block35_4_mixed (Concatenate)   (None, 61, 61, 128)  0           activation_128[0][0]             
                                                                 activation_130[0][0]             
                                                                 activation_133[0][0]             
__________________________________________________________________________________________________
block35_4_conv (Conv2D)         (None, 61, 61, 320)  41280       block35_4_mixed[0][0]            
__________________________________________________________________________________________________
block35_4 (Lambda)              (None, 61, 61, 320)  0           block35_3_ac[0][0]               
                                                                 block35_4_conv[0][0]             
__________________________________________________________________________________________________
block35_4_ac (Activation)       (None, 61, 61, 320)  0           block35_4[0][0]                  
__________________________________________________________________________________________________
conv2d_168 (Conv2D)             (None, 61, 61, 32)   10240       block35_4_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_137 (BatchN (None, 61, 61, 32)   96          conv2d_168[0][0]                 
__________________________________________________________________________________________________
activation_137 (Activation)     (None, 61, 61, 32)   0           batch_normalization_137[0][0]    
__________________________________________________________________________________________________
conv2d_166 (Conv2D)             (None, 61, 61, 32)   10240       block35_4_ac[0][0]               
__________________________________________________________________________________________________
conv2d_169 (Conv2D)             (None, 61, 61, 48)   13824       activation_137[0][0]             
__________________________________________________________________________________________________
batch_normalization_135 (BatchN (None, 61, 61, 32)   96          conv2d_166[0][0]                 
__________________________________________________________________________________________________
batch_normalization_138 (BatchN (None, 61, 61, 48)   144         conv2d_169[0][0]                 
__________________________________________________________________________________________________
activation_135 (Activation)     (None, 61, 61, 32)   0           batch_normalization_135[0][0]    
__________________________________________________________________________________________________
activation_138 (Activation)     (None, 61, 61, 48)   0           batch_normalization_138[0][0]    
__________________________________________________________________________________________________
conv2d_165 (Conv2D)             (None, 61, 61, 32)   10240       block35_4_ac[0][0]               
__________________________________________________________________________________________________
conv2d_167 (Conv2D)             (None, 61, 61, 32)   9216        activation_135[0][0]             
__________________________________________________________________________________________________
conv2d_170 (Conv2D)             (None, 61, 61, 64)   27648       activation_138[0][0]             
__________________________________________________________________________________________________
batch_normalization_134 (BatchN (None, 61, 61, 32)   96          conv2d_165[0][0]                 
__________________________________________________________________________________________________
batch_normalization_136 (BatchN (None, 61, 61, 32)   96          conv2d_167[0][0]                 
__________________________________________________________________________________________________
batch_normalization_139 (BatchN (None, 61, 61, 64)   192         conv2d_170[0][0]                 
__________________________________________________________________________________________________
activation_134 (Activation)     (None, 61, 61, 32)   0           batch_normalization_134[0][0]    
__________________________________________________________________________________________________
activation_136 (Activation)     (None, 61, 61, 32)   0           batch_normalization_136[0][0]    
__________________________________________________________________________________________________
activation_139 (Activation)     (None, 61, 61, 64)   0           batch_normalization_139[0][0]    
__________________________________________________________________________________________________
block35_5_mixed (Concatenate)   (None, 61, 61, 128)  0           activation_134[0][0]             
                                                                 activation_136[0][0]             
                                                                 activation_139[0][0]             
__________________________________________________________________________________________________
block35_5_conv (Conv2D)         (None, 61, 61, 320)  41280       block35_5_mixed[0][0]            
__________________________________________________________________________________________________
block35_5 (Lambda)              (None, 61, 61, 320)  0           block35_4_ac[0][0]               
                                                                 block35_5_conv[0][0]             
__________________________________________________________________________________________________
block35_5_ac (Activation)       (None, 61, 61, 320)  0           block35_5[0][0]                  
__________________________________________________________________________________________________
conv2d_174 (Conv2D)             (None, 61, 61, 32)   10240       block35_5_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_143 (BatchN (None, 61, 61, 32)   96          conv2d_174[0][0]                 
__________________________________________________________________________________________________
activation_143 (Activation)     (None, 61, 61, 32)   0           batch_normalization_143[0][0]    
__________________________________________________________________________________________________
conv2d_172 (Conv2D)             (None, 61, 61, 32)   10240       block35_5_ac[0][0]               
__________________________________________________________________________________________________
conv2d_175 (Conv2D)             (None, 61, 61, 48)   13824       activation_143[0][0]             
__________________________________________________________________________________________________
batch_normalization_141 (BatchN (None, 61, 61, 32)   96          conv2d_172[0][0]                 
__________________________________________________________________________________________________
batch_normalization_144 (BatchN (None, 61, 61, 48)   144         conv2d_175[0][0]                 
__________________________________________________________________________________________________
activation_141 (Activation)     (None, 61, 61, 32)   0           batch_normalization_141[0][0]    
__________________________________________________________________________________________________
activation_144 (Activation)     (None, 61, 61, 48)   0           batch_normalization_144[0][0]    
__________________________________________________________________________________________________
conv2d_171 (Conv2D)             (None, 61, 61, 32)   10240       block35_5_ac[0][0]               
__________________________________________________________________________________________________
conv2d_173 (Conv2D)             (None, 61, 61, 32)   9216        activation_141[0][0]             
__________________________________________________________________________________________________
conv2d_176 (Conv2D)             (None, 61, 61, 64)   27648       activation_144[0][0]             
__________________________________________________________________________________________________
batch_normalization_140 (BatchN (None, 61, 61, 32)   96          conv2d_171[0][0]                 
__________________________________________________________________________________________________
batch_normalization_142 (BatchN (None, 61, 61, 32)   96          conv2d_173[0][0]                 
__________________________________________________________________________________________________
batch_normalization_145 (BatchN (None, 61, 61, 64)   192         conv2d_176[0][0]                 
__________________________________________________________________________________________________
activation_140 (Activation)     (None, 61, 61, 32)   0           batch_normalization_140[0][0]    
__________________________________________________________________________________________________
activation_142 (Activation)     (None, 61, 61, 32)   0           batch_normalization_142[0][0]    
__________________________________________________________________________________________________
activation_145 (Activation)     (None, 61, 61, 64)   0           batch_normalization_145[0][0]    
__________________________________________________________________________________________________
block35_6_mixed (Concatenate)   (None, 61, 61, 128)  0           activation_140[0][0]             
                                                                 activation_142[0][0]             
                                                                 activation_145[0][0]             
__________________________________________________________________________________________________
block35_6_conv (Conv2D)         (None, 61, 61, 320)  41280       block35_6_mixed[0][0]            
__________________________________________________________________________________________________
block35_6 (Lambda)              (None, 61, 61, 320)  0           block35_5_ac[0][0]               
                                                                 block35_6_conv[0][0]             
__________________________________________________________________________________________________
block35_6_ac (Activation)       (None, 61, 61, 320)  0           block35_6[0][0]                  
__________________________________________________________________________________________________
conv2d_180 (Conv2D)             (None, 61, 61, 32)   10240       block35_6_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_149 (BatchN (None, 61, 61, 32)   96          conv2d_180[0][0]                 
__________________________________________________________________________________________________
activation_149 (Activation)     (None, 61, 61, 32)   0           batch_normalization_149[0][0]    
__________________________________________________________________________________________________
conv2d_178 (Conv2D)             (None, 61, 61, 32)   10240       block35_6_ac[0][0]               
__________________________________________________________________________________________________
conv2d_181 (Conv2D)             (None, 61, 61, 48)   13824       activation_149[0][0]             
__________________________________________________________________________________________________
batch_normalization_147 (BatchN (None, 61, 61, 32)   96          conv2d_178[0][0]                 
__________________________________________________________________________________________________
batch_normalization_150 (BatchN (None, 61, 61, 48)   144         conv2d_181[0][0]                 
__________________________________________________________________________________________________
activation_147 (Activation)     (None, 61, 61, 32)   0           batch_normalization_147[0][0]    
__________________________________________________________________________________________________
activation_150 (Activation)     (None, 61, 61, 48)   0           batch_normalization_150[0][0]    
__________________________________________________________________________________________________
conv2d_177 (Conv2D)             (None, 61, 61, 32)   10240       block35_6_ac[0][0]               
__________________________________________________________________________________________________
conv2d_179 (Conv2D)             (None, 61, 61, 32)   9216        activation_147[0][0]             
__________________________________________________________________________________________________
conv2d_182 (Conv2D)             (None, 61, 61, 64)   27648       activation_150[0][0]             
__________________________________________________________________________________________________
batch_normalization_146 (BatchN (None, 61, 61, 32)   96          conv2d_177[0][0]                 
__________________________________________________________________________________________________
batch_normalization_148 (BatchN (None, 61, 61, 32)   96          conv2d_179[0][0]                 
__________________________________________________________________________________________________
batch_normalization_151 (BatchN (None, 61, 61, 64)   192         conv2d_182[0][0]                 
__________________________________________________________________________________________________
activation_146 (Activation)     (None, 61, 61, 32)   0           batch_normalization_146[0][0]    
__________________________________________________________________________________________________
activation_148 (Activation)     (None, 61, 61, 32)   0           batch_normalization_148[0][0]    
__________________________________________________________________________________________________
activation_151 (Activation)     (None, 61, 61, 64)   0           batch_normalization_151[0][0]    
__________________________________________________________________________________________________
block35_7_mixed (Concatenate)   (None, 61, 61, 128)  0           activation_146[0][0]             
                                                                 activation_148[0][0]             
                                                                 activation_151[0][0]             
__________________________________________________________________________________________________
block35_7_conv (Conv2D)         (None, 61, 61, 320)  41280       block35_7_mixed[0][0]            
__________________________________________________________________________________________________
block35_7 (Lambda)              (None, 61, 61, 320)  0           block35_6_ac[0][0]               
                                                                 block35_7_conv[0][0]             
__________________________________________________________________________________________________
block35_7_ac (Activation)       (None, 61, 61, 320)  0           block35_7[0][0]                  
__________________________________________________________________________________________________
conv2d_186 (Conv2D)             (None, 61, 61, 32)   10240       block35_7_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_155 (BatchN (None, 61, 61, 32)   96          conv2d_186[0][0]                 
__________________________________________________________________________________________________
activation_155 (Activation)     (None, 61, 61, 32)   0           batch_normalization_155[0][0]    
__________________________________________________________________________________________________
conv2d_184 (Conv2D)             (None, 61, 61, 32)   10240       block35_7_ac[0][0]               
__________________________________________________________________________________________________
conv2d_187 (Conv2D)             (None, 61, 61, 48)   13824       activation_155[0][0]             
__________________________________________________________________________________________________
batch_normalization_153 (BatchN (None, 61, 61, 32)   96          conv2d_184[0][0]                 
__________________________________________________________________________________________________
batch_normalization_156 (BatchN (None, 61, 61, 48)   144         conv2d_187[0][0]                 
__________________________________________________________________________________________________
activation_153 (Activation)     (None, 61, 61, 32)   0           batch_normalization_153[0][0]    
__________________________________________________________________________________________________
activation_156 (Activation)     (None, 61, 61, 48)   0           batch_normalization_156[0][0]    
__________________________________________________________________________________________________
conv2d_183 (Conv2D)             (None, 61, 61, 32)   10240       block35_7_ac[0][0]               
__________________________________________________________________________________________________
conv2d_185 (Conv2D)             (None, 61, 61, 32)   9216        activation_153[0][0]             
__________________________________________________________________________________________________
conv2d_188 (Conv2D)             (None, 61, 61, 64)   27648       activation_156[0][0]             
__________________________________________________________________________________________________
batch_normalization_152 (BatchN (None, 61, 61, 32)   96          conv2d_183[0][0]                 
__________________________________________________________________________________________________
batch_normalization_154 (BatchN (None, 61, 61, 32)   96          conv2d_185[0][0]                 
__________________________________________________________________________________________________
batch_normalization_157 (BatchN (None, 61, 61, 64)   192         conv2d_188[0][0]                 
__________________________________________________________________________________________________
activation_152 (Activation)     (None, 61, 61, 32)   0           batch_normalization_152[0][0]    
__________________________________________________________________________________________________
activation_154 (Activation)     (None, 61, 61, 32)   0           batch_normalization_154[0][0]    
__________________________________________________________________________________________________
activation_157 (Activation)     (None, 61, 61, 64)   0           batch_normalization_157[0][0]    
__________________________________________________________________________________________________
block35_8_mixed (Concatenate)   (None, 61, 61, 128)  0           activation_152[0][0]             
                                                                 activation_154[0][0]             
                                                                 activation_157[0][0]             
__________________________________________________________________________________________________
block35_8_conv (Conv2D)         (None, 61, 61, 320)  41280       block35_8_mixed[0][0]            
__________________________________________________________________________________________________
block35_8 (Lambda)              (None, 61, 61, 320)  0           block35_7_ac[0][0]               
                                                                 block35_8_conv[0][0]             
__________________________________________________________________________________________________
block35_8_ac (Activation)       (None, 61, 61, 320)  0           block35_8[0][0]                  
__________________________________________________________________________________________________
conv2d_192 (Conv2D)             (None, 61, 61, 32)   10240       block35_8_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_161 (BatchN (None, 61, 61, 32)   96          conv2d_192[0][0]                 
__________________________________________________________________________________________________
activation_161 (Activation)     (None, 61, 61, 32)   0           batch_normalization_161[0][0]    
__________________________________________________________________________________________________
conv2d_190 (Conv2D)             (None, 61, 61, 32)   10240       block35_8_ac[0][0]               
__________________________________________________________________________________________________
conv2d_193 (Conv2D)             (None, 61, 61, 48)   13824       activation_161[0][0]             
__________________________________________________________________________________________________
batch_normalization_159 (BatchN (None, 61, 61, 32)   96          conv2d_190[0][0]                 
__________________________________________________________________________________________________
batch_normalization_162 (BatchN (None, 61, 61, 48)   144         conv2d_193[0][0]                 
__________________________________________________________________________________________________
activation_159 (Activation)     (None, 61, 61, 32)   0           batch_normalization_159[0][0]    
__________________________________________________________________________________________________
activation_162 (Activation)     (None, 61, 61, 48)   0           batch_normalization_162[0][0]    
__________________________________________________________________________________________________
conv2d_189 (Conv2D)             (None, 61, 61, 32)   10240       block35_8_ac[0][0]               
__________________________________________________________________________________________________
conv2d_191 (Conv2D)             (None, 61, 61, 32)   9216        activation_159[0][0]             
__________________________________________________________________________________________________
conv2d_194 (Conv2D)             (None, 61, 61, 64)   27648       activation_162[0][0]             
__________________________________________________________________________________________________
batch_normalization_158 (BatchN (None, 61, 61, 32)   96          conv2d_189[0][0]                 
__________________________________________________________________________________________________
batch_normalization_160 (BatchN (None, 61, 61, 32)   96          conv2d_191[0][0]                 
__________________________________________________________________________________________________
batch_normalization_163 (BatchN (None, 61, 61, 64)   192         conv2d_194[0][0]                 
__________________________________________________________________________________________________
activation_158 (Activation)     (None, 61, 61, 32)   0           batch_normalization_158[0][0]    
__________________________________________________________________________________________________
activation_160 (Activation)     (None, 61, 61, 32)   0           batch_normalization_160[0][0]    
__________________________________________________________________________________________________
activation_163 (Activation)     (None, 61, 61, 64)   0           batch_normalization_163[0][0]    
__________________________________________________________________________________________________
block35_9_mixed (Concatenate)   (None, 61, 61, 128)  0           activation_158[0][0]             
                                                                 activation_160[0][0]             
                                                                 activation_163[0][0]             
__________________________________________________________________________________________________
block35_9_conv (Conv2D)         (None, 61, 61, 320)  41280       block35_9_mixed[0][0]            
__________________________________________________________________________________________________
block35_9 (Lambda)              (None, 61, 61, 320)  0           block35_8_ac[0][0]               
                                                                 block35_9_conv[0][0]             
__________________________________________________________________________________________________
block35_9_ac (Activation)       (None, 61, 61, 320)  0           block35_9[0][0]                  
__________________________________________________________________________________________________
conv2d_198 (Conv2D)             (None, 61, 61, 32)   10240       block35_9_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_167 (BatchN (None, 61, 61, 32)   96          conv2d_198[0][0]                 
__________________________________________________________________________________________________
activation_167 (Activation)     (None, 61, 61, 32)   0           batch_normalization_167[0][0]    
__________________________________________________________________________________________________
conv2d_196 (Conv2D)             (None, 61, 61, 32)   10240       block35_9_ac[0][0]               
__________________________________________________________________________________________________
conv2d_199 (Conv2D)             (None, 61, 61, 48)   13824       activation_167[0][0]             
__________________________________________________________________________________________________
batch_normalization_165 (BatchN (None, 61, 61, 32)   96          conv2d_196[0][0]                 
__________________________________________________________________________________________________
batch_normalization_168 (BatchN (None, 61, 61, 48)   144         conv2d_199[0][0]                 
__________________________________________________________________________________________________
activation_165 (Activation)     (None, 61, 61, 32)   0           batch_normalization_165[0][0]    
__________________________________________________________________________________________________
activation_168 (Activation)     (None, 61, 61, 48)   0           batch_normalization_168[0][0]    
__________________________________________________________________________________________________
conv2d_195 (Conv2D)             (None, 61, 61, 32)   10240       block35_9_ac[0][0]               
__________________________________________________________________________________________________
conv2d_197 (Conv2D)             (None, 61, 61, 32)   9216        activation_165[0][0]             
__________________________________________________________________________________________________
conv2d_200 (Conv2D)             (None, 61, 61, 64)   27648       activation_168[0][0]             
__________________________________________________________________________________________________
batch_normalization_164 (BatchN (None, 61, 61, 32)   96          conv2d_195[0][0]                 
__________________________________________________________________________________________________
batch_normalization_166 (BatchN (None, 61, 61, 32)   96          conv2d_197[0][0]                 
__________________________________________________________________________________________________
batch_normalization_169 (BatchN (None, 61, 61, 64)   192         conv2d_200[0][0]                 
__________________________________________________________________________________________________
activation_164 (Activation)     (None, 61, 61, 32)   0           batch_normalization_164[0][0]    
__________________________________________________________________________________________________
activation_166 (Activation)     (None, 61, 61, 32)   0           batch_normalization_166[0][0]    
__________________________________________________________________________________________________
activation_169 (Activation)     (None, 61, 61, 64)   0           batch_normalization_169[0][0]    
__________________________________________________________________________________________________
block35_10_mixed (Concatenate)  (None, 61, 61, 128)  0           activation_164[0][0]             
                                                                 activation_166[0][0]             
                                                                 activation_169[0][0]             
__________________________________________________________________________________________________
block35_10_conv (Conv2D)        (None, 61, 61, 320)  41280       block35_10_mixed[0][0]           
__________________________________________________________________________________________________
block35_10 (Lambda)             (None, 61, 61, 320)  0           block35_9_ac[0][0]               
                                                                 block35_10_conv[0][0]            
__________________________________________________________________________________________________
block35_10_ac (Activation)      (None, 61, 61, 320)  0           block35_10[0][0]                 
__________________________________________________________________________________________________
conv2d_202 (Conv2D)             (None, 61, 61, 256)  81920       block35_10_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_171 (BatchN (None, 61, 61, 256)  768         conv2d_202[0][0]                 
__________________________________________________________________________________________________
activation_171 (Activation)     (None, 61, 61, 256)  0           batch_normalization_171[0][0]    
__________________________________________________________________________________________________
conv2d_203 (Conv2D)             (None, 61, 61, 256)  589824      activation_171[0][0]             
__________________________________________________________________________________________________
batch_normalization_172 (BatchN (None, 61, 61, 256)  768         conv2d_203[0][0]                 
__________________________________________________________________________________________________
activation_172 (Activation)     (None, 61, 61, 256)  0           batch_normalization_172[0][0]    
__________________________________________________________________________________________________
conv2d_201 (Conv2D)             (None, 30, 30, 384)  1105920     block35_10_ac[0][0]              
__________________________________________________________________________________________________
conv2d_204 (Conv2D)             (None, 30, 30, 384)  884736      activation_172[0][0]             
__________________________________________________________________________________________________
batch_normalization_170 (BatchN (None, 30, 30, 384)  1152        conv2d_201[0][0]                 
__________________________________________________________________________________________________
batch_normalization_173 (BatchN (None, 30, 30, 384)  1152        conv2d_204[0][0]                 
__________________________________________________________________________________________________
activation_170 (Activation)     (None, 30, 30, 384)  0           batch_normalization_170[0][0]    
__________________________________________________________________________________________________
activation_173 (Activation)     (None, 30, 30, 384)  0           batch_normalization_173[0][0]    
__________________________________________________________________________________________________
max_pooling2d_16 (MaxPooling2D) (None, 30, 30, 320)  0           block35_10_ac[0][0]              
__________________________________________________________________________________________________
mixed_6a (Concatenate)          (None, 30, 30, 1088) 0           activation_170[0][0]             
                                                                 activation_173[0][0]             
                                                                 max_pooling2d_16[0][0]           
__________________________________________________________________________________________________
conv2d_206 (Conv2D)             (None, 30, 30, 128)  139264      mixed_6a[0][0]                   
__________________________________________________________________________________________________
batch_normalization_175 (BatchN (None, 30, 30, 128)  384         conv2d_206[0][0]                 
__________________________________________________________________________________________________
activation_175 (Activation)     (None, 30, 30, 128)  0           batch_normalization_175[0][0]    
__________________________________________________________________________________________________
conv2d_207 (Conv2D)             (None, 30, 30, 160)  143360      activation_175[0][0]             
__________________________________________________________________________________________________
batch_normalization_176 (BatchN (None, 30, 30, 160)  480         conv2d_207[0][0]                 
__________________________________________________________________________________________________
activation_176 (Activation)     (None, 30, 30, 160)  0           batch_normalization_176[0][0]    
__________________________________________________________________________________________________
conv2d_205 (Conv2D)             (None, 30, 30, 192)  208896      mixed_6a[0][0]                   
__________________________________________________________________________________________________
conv2d_208 (Conv2D)             (None, 30, 30, 192)  215040      activation_176[0][0]             
__________________________________________________________________________________________________
batch_normalization_174 (BatchN (None, 30, 30, 192)  576         conv2d_205[0][0]                 
__________________________________________________________________________________________________
batch_normalization_177 (BatchN (None, 30, 30, 192)  576         conv2d_208[0][0]                 
__________________________________________________________________________________________________
activation_174 (Activation)     (None, 30, 30, 192)  0           batch_normalization_174[0][0]    
__________________________________________________________________________________________________
activation_177 (Activation)     (None, 30, 30, 192)  0           batch_normalization_177[0][0]    
__________________________________________________________________________________________________
block17_1_mixed (Concatenate)   (None, 30, 30, 384)  0           activation_174[0][0]             
                                                                 activation_177[0][0]             
__________________________________________________________________________________________________
block17_1_conv (Conv2D)         (None, 30, 30, 1088) 418880      block17_1_mixed[0][0]            
__________________________________________________________________________________________________
block17_1 (Lambda)              (None, 30, 30, 1088) 0           mixed_6a[0][0]                   
                                                                 block17_1_conv[0][0]             
__________________________________________________________________________________________________
block17_1_ac (Activation)       (None, 30, 30, 1088) 0           block17_1[0][0]                  
__________________________________________________________________________________________________
conv2d_210 (Conv2D)             (None, 30, 30, 128)  139264      block17_1_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_179 (BatchN (None, 30, 30, 128)  384         conv2d_210[0][0]                 
__________________________________________________________________________________________________
activation_179 (Activation)     (None, 30, 30, 128)  0           batch_normalization_179[0][0]    
__________________________________________________________________________________________________
conv2d_211 (Conv2D)             (None, 30, 30, 160)  143360      activation_179[0][0]             
__________________________________________________________________________________________________
batch_normalization_180 (BatchN (None, 30, 30, 160)  480         conv2d_211[0][0]                 
__________________________________________________________________________________________________
activation_180 (Activation)     (None, 30, 30, 160)  0           batch_normalization_180[0][0]    
__________________________________________________________________________________________________
conv2d_209 (Conv2D)             (None, 30, 30, 192)  208896      block17_1_ac[0][0]               
__________________________________________________________________________________________________
conv2d_212 (Conv2D)             (None, 30, 30, 192)  215040      activation_180[0][0]             
__________________________________________________________________________________________________
batch_normalization_178 (BatchN (None, 30, 30, 192)  576         conv2d_209[0][0]                 
__________________________________________________________________________________________________
batch_normalization_181 (BatchN (None, 30, 30, 192)  576         conv2d_212[0][0]                 
__________________________________________________________________________________________________
activation_178 (Activation)     (None, 30, 30, 192)  0           batch_normalization_178[0][0]    
__________________________________________________________________________________________________
activation_181 (Activation)     (None, 30, 30, 192)  0           batch_normalization_181[0][0]    
__________________________________________________________________________________________________
block17_2_mixed (Concatenate)   (None, 30, 30, 384)  0           activation_178[0][0]             
                                                                 activation_181[0][0]             
__________________________________________________________________________________________________
block17_2_conv (Conv2D)         (None, 30, 30, 1088) 418880      block17_2_mixed[0][0]            
__________________________________________________________________________________________________
block17_2 (Lambda)              (None, 30, 30, 1088) 0           block17_1_ac[0][0]               
                                                                 block17_2_conv[0][0]             
__________________________________________________________________________________________________
block17_2_ac (Activation)       (None, 30, 30, 1088) 0           block17_2[0][0]                  
__________________________________________________________________________________________________
conv2d_214 (Conv2D)             (None, 30, 30, 128)  139264      block17_2_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_183 (BatchN (None, 30, 30, 128)  384         conv2d_214[0][0]                 
__________________________________________________________________________________________________
activation_183 (Activation)     (None, 30, 30, 128)  0           batch_normalization_183[0][0]    
__________________________________________________________________________________________________
conv2d_215 (Conv2D)             (None, 30, 30, 160)  143360      activation_183[0][0]             
__________________________________________________________________________________________________
batch_normalization_184 (BatchN (None, 30, 30, 160)  480         conv2d_215[0][0]                 
__________________________________________________________________________________________________
activation_184 (Activation)     (None, 30, 30, 160)  0           batch_normalization_184[0][0]    
__________________________________________________________________________________________________
conv2d_213 (Conv2D)             (None, 30, 30, 192)  208896      block17_2_ac[0][0]               
__________________________________________________________________________________________________
conv2d_216 (Conv2D)             (None, 30, 30, 192)  215040      activation_184[0][0]             
__________________________________________________________________________________________________
batch_normalization_182 (BatchN (None, 30, 30, 192)  576         conv2d_213[0][0]                 
__________________________________________________________________________________________________
batch_normalization_185 (BatchN (None, 30, 30, 192)  576         conv2d_216[0][0]                 
__________________________________________________________________________________________________
activation_182 (Activation)     (None, 30, 30, 192)  0           batch_normalization_182[0][0]    
__________________________________________________________________________________________________
activation_185 (Activation)     (None, 30, 30, 192)  0           batch_normalization_185[0][0]    
__________________________________________________________________________________________________
block17_3_mixed (Concatenate)   (None, 30, 30, 384)  0           activation_182[0][0]             
                                                                 activation_185[0][0]             
__________________________________________________________________________________________________
block17_3_conv (Conv2D)         (None, 30, 30, 1088) 418880      block17_3_mixed[0][0]            
__________________________________________________________________________________________________
block17_3 (Lambda)              (None, 30, 30, 1088) 0           block17_2_ac[0][0]               
                                                                 block17_3_conv[0][0]             
__________________________________________________________________________________________________
block17_3_ac (Activation)       (None, 30, 30, 1088) 0           block17_3[0][0]                  
__________________________________________________________________________________________________
conv2d_218 (Conv2D)             (None, 30, 30, 128)  139264      block17_3_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_187 (BatchN (None, 30, 30, 128)  384         conv2d_218[0][0]                 
__________________________________________________________________________________________________
activation_187 (Activation)     (None, 30, 30, 128)  0           batch_normalization_187[0][0]    
__________________________________________________________________________________________________
conv2d_219 (Conv2D)             (None, 30, 30, 160)  143360      activation_187[0][0]             
__________________________________________________________________________________________________
batch_normalization_188 (BatchN (None, 30, 30, 160)  480         conv2d_219[0][0]                 
__________________________________________________________________________________________________
activation_188 (Activation)     (None, 30, 30, 160)  0           batch_normalization_188[0][0]    
__________________________________________________________________________________________________
conv2d_217 (Conv2D)             (None, 30, 30, 192)  208896      block17_3_ac[0][0]               
__________________________________________________________________________________________________
conv2d_220 (Conv2D)             (None, 30, 30, 192)  215040      activation_188[0][0]             
__________________________________________________________________________________________________
batch_normalization_186 (BatchN (None, 30, 30, 192)  576         conv2d_217[0][0]                 
__________________________________________________________________________________________________
batch_normalization_189 (BatchN (None, 30, 30, 192)  576         conv2d_220[0][0]                 
__________________________________________________________________________________________________
activation_186 (Activation)     (None, 30, 30, 192)  0           batch_normalization_186[0][0]    
__________________________________________________________________________________________________
activation_189 (Activation)     (None, 30, 30, 192)  0           batch_normalization_189[0][0]    
__________________________________________________________________________________________________
block17_4_mixed (Concatenate)   (None, 30, 30, 384)  0           activation_186[0][0]             
                                                                 activation_189[0][0]             
__________________________________________________________________________________________________
block17_4_conv (Conv2D)         (None, 30, 30, 1088) 418880      block17_4_mixed[0][0]            
__________________________________________________________________________________________________
block17_4 (Lambda)              (None, 30, 30, 1088) 0           block17_3_ac[0][0]               
                                                                 block17_4_conv[0][0]             
__________________________________________________________________________________________________
block17_4_ac (Activation)       (None, 30, 30, 1088) 0           block17_4[0][0]                  
__________________________________________________________________________________________________
conv2d_222 (Conv2D)             (None, 30, 30, 128)  139264      block17_4_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_191 (BatchN (None, 30, 30, 128)  384         conv2d_222[0][0]                 
__________________________________________________________________________________________________
activation_191 (Activation)     (None, 30, 30, 128)  0           batch_normalization_191[0][0]    
__________________________________________________________________________________________________
conv2d_223 (Conv2D)             (None, 30, 30, 160)  143360      activation_191[0][0]             
__________________________________________________________________________________________________
batch_normalization_192 (BatchN (None, 30, 30, 160)  480         conv2d_223[0][0]                 
__________________________________________________________________________________________________
activation_192 (Activation)     (None, 30, 30, 160)  0           batch_normalization_192[0][0]    
__________________________________________________________________________________________________
conv2d_221 (Conv2D)             (None, 30, 30, 192)  208896      block17_4_ac[0][0]               
__________________________________________________________________________________________________
conv2d_224 (Conv2D)             (None, 30, 30, 192)  215040      activation_192[0][0]             
__________________________________________________________________________________________________
batch_normalization_190 (BatchN (None, 30, 30, 192)  576         conv2d_221[0][0]                 
__________________________________________________________________________________________________
batch_normalization_193 (BatchN (None, 30, 30, 192)  576         conv2d_224[0][0]                 
__________________________________________________________________________________________________
activation_190 (Activation)     (None, 30, 30, 192)  0           batch_normalization_190[0][0]    
__________________________________________________________________________________________________
activation_193 (Activation)     (None, 30, 30, 192)  0           batch_normalization_193[0][0]    
__________________________________________________________________________________________________
block17_5_mixed (Concatenate)   (None, 30, 30, 384)  0           activation_190[0][0]             
                                                                 activation_193[0][0]             
__________________________________________________________________________________________________
block17_5_conv (Conv2D)         (None, 30, 30, 1088) 418880      block17_5_mixed[0][0]            
__________________________________________________________________________________________________
block17_5 (Lambda)              (None, 30, 30, 1088) 0           block17_4_ac[0][0]               
                                                                 block17_5_conv[0][0]             
__________________________________________________________________________________________________
block17_5_ac (Activation)       (None, 30, 30, 1088) 0           block17_5[0][0]                  
__________________________________________________________________________________________________
conv2d_226 (Conv2D)             (None, 30, 30, 128)  139264      block17_5_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_195 (BatchN (None, 30, 30, 128)  384         conv2d_226[0][0]                 
__________________________________________________________________________________________________
activation_195 (Activation)     (None, 30, 30, 128)  0           batch_normalization_195[0][0]    
__________________________________________________________________________________________________
conv2d_227 (Conv2D)             (None, 30, 30, 160)  143360      activation_195[0][0]             
__________________________________________________________________________________________________
batch_normalization_196 (BatchN (None, 30, 30, 160)  480         conv2d_227[0][0]                 
__________________________________________________________________________________________________
activation_196 (Activation)     (None, 30, 30, 160)  0           batch_normalization_196[0][0]    
__________________________________________________________________________________________________
conv2d_225 (Conv2D)             (None, 30, 30, 192)  208896      block17_5_ac[0][0]               
__________________________________________________________________________________________________
conv2d_228 (Conv2D)             (None, 30, 30, 192)  215040      activation_196[0][0]             
__________________________________________________________________________________________________
batch_normalization_194 (BatchN (None, 30, 30, 192)  576         conv2d_225[0][0]                 
__________________________________________________________________________________________________
batch_normalization_197 (BatchN (None, 30, 30, 192)  576         conv2d_228[0][0]                 
__________________________________________________________________________________________________
activation_194 (Activation)     (None, 30, 30, 192)  0           batch_normalization_194[0][0]    
__________________________________________________________________________________________________
activation_197 (Activation)     (None, 30, 30, 192)  0           batch_normalization_197[0][0]    
__________________________________________________________________________________________________
block17_6_mixed (Concatenate)   (None, 30, 30, 384)  0           activation_194[0][0]             
                                                                 activation_197[0][0]             
__________________________________________________________________________________________________
block17_6_conv (Conv2D)         (None, 30, 30, 1088) 418880      block17_6_mixed[0][0]            
__________________________________________________________________________________________________
block17_6 (Lambda)              (None, 30, 30, 1088) 0           block17_5_ac[0][0]               
                                                                 block17_6_conv[0][0]             
__________________________________________________________________________________________________
block17_6_ac (Activation)       (None, 30, 30, 1088) 0           block17_6[0][0]                  
__________________________________________________________________________________________________
conv2d_230 (Conv2D)             (None, 30, 30, 128)  139264      block17_6_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_199 (BatchN (None, 30, 30, 128)  384         conv2d_230[0][0]                 
__________________________________________________________________________________________________
activation_199 (Activation)     (None, 30, 30, 128)  0           batch_normalization_199[0][0]    
__________________________________________________________________________________________________
conv2d_231 (Conv2D)             (None, 30, 30, 160)  143360      activation_199[0][0]             
__________________________________________________________________________________________________
batch_normalization_200 (BatchN (None, 30, 30, 160)  480         conv2d_231[0][0]                 
__________________________________________________________________________________________________
activation_200 (Activation)     (None, 30, 30, 160)  0           batch_normalization_200[0][0]    
__________________________________________________________________________________________________
conv2d_229 (Conv2D)             (None, 30, 30, 192)  208896      block17_6_ac[0][0]               
__________________________________________________________________________________________________
conv2d_232 (Conv2D)             (None, 30, 30, 192)  215040      activation_200[0][0]             
__________________________________________________________________________________________________
batch_normalization_198 (BatchN (None, 30, 30, 192)  576         conv2d_229[0][0]                 
__________________________________________________________________________________________________
batch_normalization_201 (BatchN (None, 30, 30, 192)  576         conv2d_232[0][0]                 
__________________________________________________________________________________________________
activation_198 (Activation)     (None, 30, 30, 192)  0           batch_normalization_198[0][0]    
__________________________________________________________________________________________________
activation_201 (Activation)     (None, 30, 30, 192)  0           batch_normalization_201[0][0]    
__________________________________________________________________________________________________
block17_7_mixed (Concatenate)   (None, 30, 30, 384)  0           activation_198[0][0]             
                                                                 activation_201[0][0]             
__________________________________________________________________________________________________
block17_7_conv (Conv2D)         (None, 30, 30, 1088) 418880      block17_7_mixed[0][0]            
__________________________________________________________________________________________________
block17_7 (Lambda)              (None, 30, 30, 1088) 0           block17_6_ac[0][0]               
                                                                 block17_7_conv[0][0]             
__________________________________________________________________________________________________
block17_7_ac (Activation)       (None, 30, 30, 1088) 0           block17_7[0][0]                  
__________________________________________________________________________________________________
conv2d_234 (Conv2D)             (None, 30, 30, 128)  139264      block17_7_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_203 (BatchN (None, 30, 30, 128)  384         conv2d_234[0][0]                 
__________________________________________________________________________________________________
activation_203 (Activation)     (None, 30, 30, 128)  0           batch_normalization_203[0][0]    
__________________________________________________________________________________________________
conv2d_235 (Conv2D)             (None, 30, 30, 160)  143360      activation_203[0][0]             
__________________________________________________________________________________________________
batch_normalization_204 (BatchN (None, 30, 30, 160)  480         conv2d_235[0][0]                 
__________________________________________________________________________________________________
activation_204 (Activation)     (None, 30, 30, 160)  0           batch_normalization_204[0][0]    
__________________________________________________________________________________________________
conv2d_233 (Conv2D)             (None, 30, 30, 192)  208896      block17_7_ac[0][0]               
__________________________________________________________________________________________________
conv2d_236 (Conv2D)             (None, 30, 30, 192)  215040      activation_204[0][0]             
__________________________________________________________________________________________________
batch_normalization_202 (BatchN (None, 30, 30, 192)  576         conv2d_233[0][0]                 
__________________________________________________________________________________________________
batch_normalization_205 (BatchN (None, 30, 30, 192)  576         conv2d_236[0][0]                 
__________________________________________________________________________________________________
activation_202 (Activation)     (None, 30, 30, 192)  0           batch_normalization_202[0][0]    
__________________________________________________________________________________________________
activation_205 (Activation)     (None, 30, 30, 192)  0           batch_normalization_205[0][0]    
__________________________________________________________________________________________________
block17_8_mixed (Concatenate)   (None, 30, 30, 384)  0           activation_202[0][0]             
                                                                 activation_205[0][0]             
__________________________________________________________________________________________________
block17_8_conv (Conv2D)         (None, 30, 30, 1088) 418880      block17_8_mixed[0][0]            
__________________________________________________________________________________________________
block17_8 (Lambda)              (None, 30, 30, 1088) 0           block17_7_ac[0][0]               
                                                                 block17_8_conv[0][0]             
__________________________________________________________________________________________________
block17_8_ac (Activation)       (None, 30, 30, 1088) 0           block17_8[0][0]                  
__________________________________________________________________________________________________
conv2d_238 (Conv2D)             (None, 30, 30, 128)  139264      block17_8_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_207 (BatchN (None, 30, 30, 128)  384         conv2d_238[0][0]                 
__________________________________________________________________________________________________
activation_207 (Activation)     (None, 30, 30, 128)  0           batch_normalization_207[0][0]    
__________________________________________________________________________________________________
conv2d_239 (Conv2D)             (None, 30, 30, 160)  143360      activation_207[0][0]             
__________________________________________________________________________________________________
batch_normalization_208 (BatchN (None, 30, 30, 160)  480         conv2d_239[0][0]                 
__________________________________________________________________________________________________
activation_208 (Activation)     (None, 30, 30, 160)  0           batch_normalization_208[0][0]    
__________________________________________________________________________________________________
conv2d_237 (Conv2D)             (None, 30, 30, 192)  208896      block17_8_ac[0][0]               
__________________________________________________________________________________________________
conv2d_240 (Conv2D)             (None, 30, 30, 192)  215040      activation_208[0][0]             
__________________________________________________________________________________________________
batch_normalization_206 (BatchN (None, 30, 30, 192)  576         conv2d_237[0][0]                 
__________________________________________________________________________________________________
batch_normalization_209 (BatchN (None, 30, 30, 192)  576         conv2d_240[0][0]                 
__________________________________________________________________________________________________
activation_206 (Activation)     (None, 30, 30, 192)  0           batch_normalization_206[0][0]    
__________________________________________________________________________________________________
activation_209 (Activation)     (None, 30, 30, 192)  0           batch_normalization_209[0][0]    
__________________________________________________________________________________________________
block17_9_mixed (Concatenate)   (None, 30, 30, 384)  0           activation_206[0][0]             
                                                                 activation_209[0][0]             
__________________________________________________________________________________________________
block17_9_conv (Conv2D)         (None, 30, 30, 1088) 418880      block17_9_mixed[0][0]            
__________________________________________________________________________________________________
block17_9 (Lambda)              (None, 30, 30, 1088) 0           block17_8_ac[0][0]               
                                                                 block17_9_conv[0][0]             
__________________________________________________________________________________________________
block17_9_ac (Activation)       (None, 30, 30, 1088) 0           block17_9[0][0]                  
__________________________________________________________________________________________________
conv2d_242 (Conv2D)             (None, 30, 30, 128)  139264      block17_9_ac[0][0]               
__________________________________________________________________________________________________
batch_normalization_211 (BatchN (None, 30, 30, 128)  384         conv2d_242[0][0]                 
__________________________________________________________________________________________________
activation_211 (Activation)     (None, 30, 30, 128)  0           batch_normalization_211[0][0]    
__________________________________________________________________________________________________
conv2d_243 (Conv2D)             (None, 30, 30, 160)  143360      activation_211[0][0]             
__________________________________________________________________________________________________
batch_normalization_212 (BatchN (None, 30, 30, 160)  480         conv2d_243[0][0]                 
__________________________________________________________________________________________________
activation_212 (Activation)     (None, 30, 30, 160)  0           batch_normalization_212[0][0]    
__________________________________________________________________________________________________
conv2d_241 (Conv2D)             (None, 30, 30, 192)  208896      block17_9_ac[0][0]               
__________________________________________________________________________________________________
conv2d_244 (Conv2D)             (None, 30, 30, 192)  215040      activation_212[0][0]             
__________________________________________________________________________________________________
batch_normalization_210 (BatchN (None, 30, 30, 192)  576         conv2d_241[0][0]                 
__________________________________________________________________________________________________
batch_normalization_213 (BatchN (None, 30, 30, 192)  576         conv2d_244[0][0]                 
__________________________________________________________________________________________________
activation_210 (Activation)     (None, 30, 30, 192)  0           batch_normalization_210[0][0]    
__________________________________________________________________________________________________
activation_213 (Activation)     (None, 30, 30, 192)  0           batch_normalization_213[0][0]    
__________________________________________________________________________________________________
block17_10_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_210[0][0]             
                                                                 activation_213[0][0]             
__________________________________________________________________________________________________
block17_10_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_10_mixed[0][0]           
__________________________________________________________________________________________________
block17_10 (Lambda)             (None, 30, 30, 1088) 0           block17_9_ac[0][0]               
                                                                 block17_10_conv[0][0]            
__________________________________________________________________________________________________
block17_10_ac (Activation)      (None, 30, 30, 1088) 0           block17_10[0][0]                 
__________________________________________________________________________________________________
conv2d_246 (Conv2D)             (None, 30, 30, 128)  139264      block17_10_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_215 (BatchN (None, 30, 30, 128)  384         conv2d_246[0][0]                 
__________________________________________________________________________________________________
activation_215 (Activation)     (None, 30, 30, 128)  0           batch_normalization_215[0][0]    
__________________________________________________________________________________________________
conv2d_247 (Conv2D)             (None, 30, 30, 160)  143360      activation_215[0][0]             
__________________________________________________________________________________________________
batch_normalization_216 (BatchN (None, 30, 30, 160)  480         conv2d_247[0][0]                 
__________________________________________________________________________________________________
activation_216 (Activation)     (None, 30, 30, 160)  0           batch_normalization_216[0][0]    
__________________________________________________________________________________________________
conv2d_245 (Conv2D)             (None, 30, 30, 192)  208896      block17_10_ac[0][0]              
__________________________________________________________________________________________________
conv2d_248 (Conv2D)             (None, 30, 30, 192)  215040      activation_216[0][0]             
__________________________________________________________________________________________________
batch_normalization_214 (BatchN (None, 30, 30, 192)  576         conv2d_245[0][0]                 
__________________________________________________________________________________________________
batch_normalization_217 (BatchN (None, 30, 30, 192)  576         conv2d_248[0][0]                 
__________________________________________________________________________________________________
activation_214 (Activation)     (None, 30, 30, 192)  0           batch_normalization_214[0][0]    
__________________________________________________________________________________________________
activation_217 (Activation)     (None, 30, 30, 192)  0           batch_normalization_217[0][0]    
__________________________________________________________________________________________________
block17_11_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_214[0][0]             
                                                                 activation_217[0][0]             
__________________________________________________________________________________________________
block17_11_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_11_mixed[0][0]           
__________________________________________________________________________________________________
block17_11 (Lambda)             (None, 30, 30, 1088) 0           block17_10_ac[0][0]              
                                                                 block17_11_conv[0][0]            
__________________________________________________________________________________________________
block17_11_ac (Activation)      (None, 30, 30, 1088) 0           block17_11[0][0]                 
__________________________________________________________________________________________________
conv2d_250 (Conv2D)             (None, 30, 30, 128)  139264      block17_11_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_219 (BatchN (None, 30, 30, 128)  384         conv2d_250[0][0]                 
__________________________________________________________________________________________________
activation_219 (Activation)     (None, 30, 30, 128)  0           batch_normalization_219[0][0]    
__________________________________________________________________________________________________
conv2d_251 (Conv2D)             (None, 30, 30, 160)  143360      activation_219[0][0]             
__________________________________________________________________________________________________
batch_normalization_220 (BatchN (None, 30, 30, 160)  480         conv2d_251[0][0]                 
__________________________________________________________________________________________________
activation_220 (Activation)     (None, 30, 30, 160)  0           batch_normalization_220[0][0]    
__________________________________________________________________________________________________
conv2d_249 (Conv2D)             (None, 30, 30, 192)  208896      block17_11_ac[0][0]              
__________________________________________________________________________________________________
conv2d_252 (Conv2D)             (None, 30, 30, 192)  215040      activation_220[0][0]             
__________________________________________________________________________________________________
batch_normalization_218 (BatchN (None, 30, 30, 192)  576         conv2d_249[0][0]                 
__________________________________________________________________________________________________
batch_normalization_221 (BatchN (None, 30, 30, 192)  576         conv2d_252[0][0]                 
__________________________________________________________________________________________________
activation_218 (Activation)     (None, 30, 30, 192)  0           batch_normalization_218[0][0]    
__________________________________________________________________________________________________
activation_221 (Activation)     (None, 30, 30, 192)  0           batch_normalization_221[0][0]    
__________________________________________________________________________________________________
block17_12_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_218[0][0]             
                                                                 activation_221[0][0]             
__________________________________________________________________________________________________
block17_12_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_12_mixed[0][0]           
__________________________________________________________________________________________________
block17_12 (Lambda)             (None, 30, 30, 1088) 0           block17_11_ac[0][0]              
                                                                 block17_12_conv[0][0]            
__________________________________________________________________________________________________
block17_12_ac (Activation)      (None, 30, 30, 1088) 0           block17_12[0][0]                 
__________________________________________________________________________________________________
conv2d_254 (Conv2D)             (None, 30, 30, 128)  139264      block17_12_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_223 (BatchN (None, 30, 30, 128)  384         conv2d_254[0][0]                 
__________________________________________________________________________________________________
activation_223 (Activation)     (None, 30, 30, 128)  0           batch_normalization_223[0][0]    
__________________________________________________________________________________________________
conv2d_255 (Conv2D)             (None, 30, 30, 160)  143360      activation_223[0][0]             
__________________________________________________________________________________________________
batch_normalization_224 (BatchN (None, 30, 30, 160)  480         conv2d_255[0][0]                 
__________________________________________________________________________________________________
activation_224 (Activation)     (None, 30, 30, 160)  0           batch_normalization_224[0][0]    
__________________________________________________________________________________________________
conv2d_253 (Conv2D)             (None, 30, 30, 192)  208896      block17_12_ac[0][0]              
__________________________________________________________________________________________________
conv2d_256 (Conv2D)             (None, 30, 30, 192)  215040      activation_224[0][0]             
__________________________________________________________________________________________________
batch_normalization_222 (BatchN (None, 30, 30, 192)  576         conv2d_253[0][0]                 
__________________________________________________________________________________________________
batch_normalization_225 (BatchN (None, 30, 30, 192)  576         conv2d_256[0][0]                 
__________________________________________________________________________________________________
activation_222 (Activation)     (None, 30, 30, 192)  0           batch_normalization_222[0][0]    
__________________________________________________________________________________________________
activation_225 (Activation)     (None, 30, 30, 192)  0           batch_normalization_225[0][0]    
__________________________________________________________________________________________________
block17_13_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_222[0][0]             
                                                                 activation_225[0][0]             
__________________________________________________________________________________________________
block17_13_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_13_mixed[0][0]           
__________________________________________________________________________________________________
block17_13 (Lambda)             (None, 30, 30, 1088) 0           block17_12_ac[0][0]              
                                                                 block17_13_conv[0][0]            
__________________________________________________________________________________________________
block17_13_ac (Activation)      (None, 30, 30, 1088) 0           block17_13[0][0]                 
__________________________________________________________________________________________________
conv2d_258 (Conv2D)             (None, 30, 30, 128)  139264      block17_13_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_227 (BatchN (None, 30, 30, 128)  384         conv2d_258[0][0]                 
__________________________________________________________________________________________________
activation_227 (Activation)     (None, 30, 30, 128)  0           batch_normalization_227[0][0]    
__________________________________________________________________________________________________
conv2d_259 (Conv2D)             (None, 30, 30, 160)  143360      activation_227[0][0]             
__________________________________________________________________________________________________
batch_normalization_228 (BatchN (None, 30, 30, 160)  480         conv2d_259[0][0]                 
__________________________________________________________________________________________________
activation_228 (Activation)     (None, 30, 30, 160)  0           batch_normalization_228[0][0]    
__________________________________________________________________________________________________
conv2d_257 (Conv2D)             (None, 30, 30, 192)  208896      block17_13_ac[0][0]              
__________________________________________________________________________________________________
conv2d_260 (Conv2D)             (None, 30, 30, 192)  215040      activation_228[0][0]             
__________________________________________________________________________________________________
batch_normalization_226 (BatchN (None, 30, 30, 192)  576         conv2d_257[0][0]                 
__________________________________________________________________________________________________
batch_normalization_229 (BatchN (None, 30, 30, 192)  576         conv2d_260[0][0]                 
__________________________________________________________________________________________________
activation_226 (Activation)     (None, 30, 30, 192)  0           batch_normalization_226[0][0]    
__________________________________________________________________________________________________
activation_229 (Activation)     (None, 30, 30, 192)  0           batch_normalization_229[0][0]    
__________________________________________________________________________________________________
block17_14_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_226[0][0]             
                                                                 activation_229[0][0]             
__________________________________________________________________________________________________
block17_14_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_14_mixed[0][0]           
__________________________________________________________________________________________________
block17_14 (Lambda)             (None, 30, 30, 1088) 0           block17_13_ac[0][0]              
                                                                 block17_14_conv[0][0]            
__________________________________________________________________________________________________
block17_14_ac (Activation)      (None, 30, 30, 1088) 0           block17_14[0][0]                 
__________________________________________________________________________________________________
conv2d_262 (Conv2D)             (None, 30, 30, 128)  139264      block17_14_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_231 (BatchN (None, 30, 30, 128)  384         conv2d_262[0][0]                 
__________________________________________________________________________________________________
activation_231 (Activation)     (None, 30, 30, 128)  0           batch_normalization_231[0][0]    
__________________________________________________________________________________________________
conv2d_263 (Conv2D)             (None, 30, 30, 160)  143360      activation_231[0][0]             
__________________________________________________________________________________________________
batch_normalization_232 (BatchN (None, 30, 30, 160)  480         conv2d_263[0][0]                 
__________________________________________________________________________________________________
activation_232 (Activation)     (None, 30, 30, 160)  0           batch_normalization_232[0][0]    
__________________________________________________________________________________________________
conv2d_261 (Conv2D)             (None, 30, 30, 192)  208896      block17_14_ac[0][0]              
__________________________________________________________________________________________________
conv2d_264 (Conv2D)             (None, 30, 30, 192)  215040      activation_232[0][0]             
__________________________________________________________________________________________________
batch_normalization_230 (BatchN (None, 30, 30, 192)  576         conv2d_261[0][0]                 
__________________________________________________________________________________________________
batch_normalization_233 (BatchN (None, 30, 30, 192)  576         conv2d_264[0][0]                 
__________________________________________________________________________________________________
activation_230 (Activation)     (None, 30, 30, 192)  0           batch_normalization_230[0][0]    
__________________________________________________________________________________________________
activation_233 (Activation)     (None, 30, 30, 192)  0           batch_normalization_233[0][0]    
__________________________________________________________________________________________________
block17_15_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_230[0][0]             
                                                                 activation_233[0][0]             
__________________________________________________________________________________________________
block17_15_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_15_mixed[0][0]           
__________________________________________________________________________________________________
block17_15 (Lambda)             (None, 30, 30, 1088) 0           block17_14_ac[0][0]              
                                                                 block17_15_conv[0][0]            
__________________________________________________________________________________________________
block17_15_ac (Activation)      (None, 30, 30, 1088) 0           block17_15[0][0]                 
__________________________________________________________________________________________________
conv2d_266 (Conv2D)             (None, 30, 30, 128)  139264      block17_15_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_235 (BatchN (None, 30, 30, 128)  384         conv2d_266[0][0]                 
__________________________________________________________________________________________________
activation_235 (Activation)     (None, 30, 30, 128)  0           batch_normalization_235[0][0]    
__________________________________________________________________________________________________
conv2d_267 (Conv2D)             (None, 30, 30, 160)  143360      activation_235[0][0]             
__________________________________________________________________________________________________
batch_normalization_236 (BatchN (None, 30, 30, 160)  480         conv2d_267[0][0]                 
__________________________________________________________________________________________________
activation_236 (Activation)     (None, 30, 30, 160)  0           batch_normalization_236[0][0]    
__________________________________________________________________________________________________
conv2d_265 (Conv2D)             (None, 30, 30, 192)  208896      block17_15_ac[0][0]              
__________________________________________________________________________________________________
conv2d_268 (Conv2D)             (None, 30, 30, 192)  215040      activation_236[0][0]             
__________________________________________________________________________________________________
batch_normalization_234 (BatchN (None, 30, 30, 192)  576         conv2d_265[0][0]                 
__________________________________________________________________________________________________
batch_normalization_237 (BatchN (None, 30, 30, 192)  576         conv2d_268[0][0]                 
__________________________________________________________________________________________________
activation_234 (Activation)     (None, 30, 30, 192)  0           batch_normalization_234[0][0]    
__________________________________________________________________________________________________
activation_237 (Activation)     (None, 30, 30, 192)  0           batch_normalization_237[0][0]    
__________________________________________________________________________________________________
block17_16_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_234[0][0]             
                                                                 activation_237[0][0]             
__________________________________________________________________________________________________
block17_16_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_16_mixed[0][0]           
__________________________________________________________________________________________________
block17_16 (Lambda)             (None, 30, 30, 1088) 0           block17_15_ac[0][0]              
                                                                 block17_16_conv[0][0]            
__________________________________________________________________________________________________
block17_16_ac (Activation)      (None, 30, 30, 1088) 0           block17_16[0][0]                 
__________________________________________________________________________________________________
conv2d_270 (Conv2D)             (None, 30, 30, 128)  139264      block17_16_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_239 (BatchN (None, 30, 30, 128)  384         conv2d_270[0][0]                 
__________________________________________________________________________________________________
activation_239 (Activation)     (None, 30, 30, 128)  0           batch_normalization_239[0][0]    
__________________________________________________________________________________________________
conv2d_271 (Conv2D)             (None, 30, 30, 160)  143360      activation_239[0][0]             
__________________________________________________________________________________________________
batch_normalization_240 (BatchN (None, 30, 30, 160)  480         conv2d_271[0][0]                 
__________________________________________________________________________________________________
activation_240 (Activation)     (None, 30, 30, 160)  0           batch_normalization_240[0][0]    
__________________________________________________________________________________________________
conv2d_269 (Conv2D)             (None, 30, 30, 192)  208896      block17_16_ac[0][0]              
__________________________________________________________________________________________________
conv2d_272 (Conv2D)             (None, 30, 30, 192)  215040      activation_240[0][0]             
__________________________________________________________________________________________________
batch_normalization_238 (BatchN (None, 30, 30, 192)  576         conv2d_269[0][0]                 
__________________________________________________________________________________________________
batch_normalization_241 (BatchN (None, 30, 30, 192)  576         conv2d_272[0][0]                 
__________________________________________________________________________________________________
activation_238 (Activation)     (None, 30, 30, 192)  0           batch_normalization_238[0][0]    
__________________________________________________________________________________________________
activation_241 (Activation)     (None, 30, 30, 192)  0           batch_normalization_241[0][0]    
__________________________________________________________________________________________________
block17_17_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_238[0][0]             
                                                                 activation_241[0][0]             
__________________________________________________________________________________________________
block17_17_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_17_mixed[0][0]           
__________________________________________________________________________________________________
block17_17 (Lambda)             (None, 30, 30, 1088) 0           block17_16_ac[0][0]              
                                                                 block17_17_conv[0][0]            
__________________________________________________________________________________________________
block17_17_ac (Activation)      (None, 30, 30, 1088) 0           block17_17[0][0]                 
__________________________________________________________________________________________________
conv2d_274 (Conv2D)             (None, 30, 30, 128)  139264      block17_17_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_243 (BatchN (None, 30, 30, 128)  384         conv2d_274[0][0]                 
__________________________________________________________________________________________________
activation_243 (Activation)     (None, 30, 30, 128)  0           batch_normalization_243[0][0]    
__________________________________________________________________________________________________
conv2d_275 (Conv2D)             (None, 30, 30, 160)  143360      activation_243[0][0]             
__________________________________________________________________________________________________
batch_normalization_244 (BatchN (None, 30, 30, 160)  480         conv2d_275[0][0]                 
__________________________________________________________________________________________________
activation_244 (Activation)     (None, 30, 30, 160)  0           batch_normalization_244[0][0]    
__________________________________________________________________________________________________
conv2d_273 (Conv2D)             (None, 30, 30, 192)  208896      block17_17_ac[0][0]              
__________________________________________________________________________________________________
conv2d_276 (Conv2D)             (None, 30, 30, 192)  215040      activation_244[0][0]             
__________________________________________________________________________________________________
batch_normalization_242 (BatchN (None, 30, 30, 192)  576         conv2d_273[0][0]                 
__________________________________________________________________________________________________
batch_normalization_245 (BatchN (None, 30, 30, 192)  576         conv2d_276[0][0]                 
__________________________________________________________________________________________________
activation_242 (Activation)     (None, 30, 30, 192)  0           batch_normalization_242[0][0]    
__________________________________________________________________________________________________
activation_245 (Activation)     (None, 30, 30, 192)  0           batch_normalization_245[0][0]    
__________________________________________________________________________________________________
block17_18_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_242[0][0]             
                                                                 activation_245[0][0]             
__________________________________________________________________________________________________
block17_18_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_18_mixed[0][0]           
__________________________________________________________________________________________________
block17_18 (Lambda)             (None, 30, 30, 1088) 0           block17_17_ac[0][0]              
                                                                 block17_18_conv[0][0]            
__________________________________________________________________________________________________
block17_18_ac (Activation)      (None, 30, 30, 1088) 0           block17_18[0][0]                 
__________________________________________________________________________________________________
conv2d_278 (Conv2D)             (None, 30, 30, 128)  139264      block17_18_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_247 (BatchN (None, 30, 30, 128)  384         conv2d_278[0][0]                 
__________________________________________________________________________________________________
activation_247 (Activation)     (None, 30, 30, 128)  0           batch_normalization_247[0][0]    
__________________________________________________________________________________________________
conv2d_279 (Conv2D)             (None, 30, 30, 160)  143360      activation_247[0][0]             
__________________________________________________________________________________________________
batch_normalization_248 (BatchN (None, 30, 30, 160)  480         conv2d_279[0][0]                 
__________________________________________________________________________________________________
activation_248 (Activation)     (None, 30, 30, 160)  0           batch_normalization_248[0][0]    
__________________________________________________________________________________________________
conv2d_277 (Conv2D)             (None, 30, 30, 192)  208896      block17_18_ac[0][0]              
__________________________________________________________________________________________________
conv2d_280 (Conv2D)             (None, 30, 30, 192)  215040      activation_248[0][0]             
__________________________________________________________________________________________________
batch_normalization_246 (BatchN (None, 30, 30, 192)  576         conv2d_277[0][0]                 
__________________________________________________________________________________________________
batch_normalization_249 (BatchN (None, 30, 30, 192)  576         conv2d_280[0][0]                 
__________________________________________________________________________________________________
activation_246 (Activation)     (None, 30, 30, 192)  0           batch_normalization_246[0][0]    
__________________________________________________________________________________________________
activation_249 (Activation)     (None, 30, 30, 192)  0           batch_normalization_249[0][0]    
__________________________________________________________________________________________________
block17_19_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_246[0][0]             
                                                                 activation_249[0][0]             
__________________________________________________________________________________________________
block17_19_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_19_mixed[0][0]           
__________________________________________________________________________________________________
block17_19 (Lambda)             (None, 30, 30, 1088) 0           block17_18_ac[0][0]              
                                                                 block17_19_conv[0][0]            
__________________________________________________________________________________________________
block17_19_ac (Activation)      (None, 30, 30, 1088) 0           block17_19[0][0]                 
__________________________________________________________________________________________________
conv2d_282 (Conv2D)             (None, 30, 30, 128)  139264      block17_19_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_251 (BatchN (None, 30, 30, 128)  384         conv2d_282[0][0]                 
__________________________________________________________________________________________________
activation_251 (Activation)     (None, 30, 30, 128)  0           batch_normalization_251[0][0]    
__________________________________________________________________________________________________
conv2d_283 (Conv2D)             (None, 30, 30, 160)  143360      activation_251[0][0]             
__________________________________________________________________________________________________
batch_normalization_252 (BatchN (None, 30, 30, 160)  480         conv2d_283[0][0]                 
__________________________________________________________________________________________________
activation_252 (Activation)     (None, 30, 30, 160)  0           batch_normalization_252[0][0]    
__________________________________________________________________________________________________
conv2d_281 (Conv2D)             (None, 30, 30, 192)  208896      block17_19_ac[0][0]              
__________________________________________________________________________________________________
conv2d_284 (Conv2D)             (None, 30, 30, 192)  215040      activation_252[0][0]             
__________________________________________________________________________________________________
batch_normalization_250 (BatchN (None, 30, 30, 192)  576         conv2d_281[0][0]                 
__________________________________________________________________________________________________
batch_normalization_253 (BatchN (None, 30, 30, 192)  576         conv2d_284[0][0]                 
__________________________________________________________________________________________________
activation_250 (Activation)     (None, 30, 30, 192)  0           batch_normalization_250[0][0]    
__________________________________________________________________________________________________
activation_253 (Activation)     (None, 30, 30, 192)  0           batch_normalization_253[0][0]    
__________________________________________________________________________________________________
block17_20_mixed (Concatenate)  (None, 30, 30, 384)  0           activation_250[0][0]             
                                                                 activation_253[0][0]             
__________________________________________________________________________________________________
block17_20_conv (Conv2D)        (None, 30, 30, 1088) 418880      block17_20_mixed[0][0]           
__________________________________________________________________________________________________
block17_20 (Lambda)             (None, 30, 30, 1088) 0           block17_19_ac[0][0]              
                                                                 block17_20_conv[0][0]            
__________________________________________________________________________________________________
block17_20_ac (Activation)      (None, 30, 30, 1088) 0           block17_20[0][0]                 
__________________________________________________________________________________________________
conv2d_289 (Conv2D)             (None, 30, 30, 256)  278528      block17_20_ac[0][0]              
__________________________________________________________________________________________________
batch_normalization_258 (BatchN (None, 30, 30, 256)  768         conv2d_289[0][0]                 
__________________________________________________________________________________________________
activation_258 (Activation)     (None, 30, 30, 256)  0           batch_normalization_258[0][0]    
__________________________________________________________________________________________________
conv2d_285 (Conv2D)             (None, 30, 30, 256)  278528      block17_20_ac[0][0]              
__________________________________________________________________________________________________
conv2d_287 (Conv2D)             (None, 30, 30, 256)  278528      block17_20_ac[0][0]              
__________________________________________________________________________________________________
conv2d_290 (Conv2D)             (None, 30, 30, 288)  663552      activation_258[0][0]             
__________________________________________________________________________________________________
batch_normalization_254 (BatchN (None, 30, 30, 256)  768         conv2d_285[0][0]                 
__________________________________________________________________________________________________
batch_normalization_256 (BatchN (None, 30, 30, 256)  768         conv2d_287[0][0]                 
__________________________________________________________________________________________________
batch_normalization_259 (BatchN (None, 30, 30, 288)  864         conv2d_290[0][0]                 
__________________________________________________________________________________________________
activation_254 (Activation)     (None, 30, 30, 256)  0           batch_normalization_254[0][0]    
__________________________________________________________________________________________________
activation_256 (Activation)     (None, 30, 30, 256)  0           batch_normalization_256[0][0]    
__________________________________________________________________________________________________
activation_259 (Activation)     (None, 30, 30, 288)  0           batch_normalization_259[0][0]    
__________________________________________________________________________________________________
conv2d_286 (Conv2D)             (None, 14, 14, 384)  884736      activation_254[0][0]             
__________________________________________________________________________________________________
conv2d_288 (Conv2D)             (None, 14, 14, 288)  663552      activation_256[0][0]             
__________________________________________________________________________________________________
conv2d_291 (Conv2D)             (None, 14, 14, 320)  829440      activation_259[0][0]             
__________________________________________________________________________________________________
batch_normalization_255 (BatchN (None, 14, 14, 384)  1152        conv2d_286[0][0]                 
__________________________________________________________________________________________________
batch_normalization_257 (BatchN (None, 14, 14, 288)  864         conv2d_288[0][0]                 
__________________________________________________________________________________________________
batch_normalization_260 (BatchN (None, 14, 14, 320)  960         conv2d_291[0][0]                 
__________________________________________________________________________________________________
activation_255 (Activation)     (None, 14, 14, 384)  0           batch_normalization_255[0][0]    
__________________________________________________________________________________________________
activation_257 (Activation)     (None, 14, 14, 288)  0           batch_normalization_257[0][0]    
__________________________________________________________________________________________________
activation_260 (Activation)     (None, 14, 14, 320)  0           batch_normalization_260[0][0]    
__________________________________________________________________________________________________
max_pooling2d_17 (MaxPooling2D) (None, 14, 14, 1088) 0           block17_20_ac[0][0]              
__________________________________________________________________________________________________
mixed_7a (Concatenate)          (None, 14, 14, 2080) 0           activation_255[0][0]             
                                                                 activation_257[0][0]             
                                                                 activation_260[0][0]             
                                                                 max_pooling2d_17[0][0]           
__________________________________________________________________________________________________
conv2d_293 (Conv2D)             (None, 14, 14, 192)  399360      mixed_7a[0][0]                   
__________________________________________________________________________________________________
batch_normalization_262 (BatchN (None, 14, 14, 192)  576         conv2d_293[0][0]                 
__________________________________________________________________________________________________
activation_262 (Activation)     (None, 14, 14, 192)  0           batch_normalization_262[0][0]    
__________________________________________________________________________________________________
conv2d_294 (Conv2D)             (None, 14, 14, 224)  129024      activation_262[0][0]             
__________________________________________________________________________________________________
batch_normalization_263 (BatchN (None, 14, 14, 224)  672         conv2d_294[0][0]                 
__________________________________________________________________________________________________
activation_263 (Activation)     (None, 14, 14, 224)  0           batch_normalization_263[0][0]    
__________________________________________________________________________________________________
conv2d_292 (Conv2D)             (None, 14, 14, 192)  399360      mixed_7a[0][0]                   
__________________________________________________________________________________________________
conv2d_295 (Conv2D)             (None, 14, 14, 256)  172032      activation_263[0][0]             
__________________________________________________________________________________________________
batch_normalization_261 (BatchN (None, 14, 14, 192)  576         conv2d_292[0][0]                 
__________________________________________________________________________________________________
batch_normalization_264 (BatchN (None, 14, 14, 256)  768         conv2d_295[0][0]                 
__________________________________________________________________________________________________
activation_261 (Activation)     (None, 14, 14, 192)  0           batch_normalization_261[0][0]    
__________________________________________________________________________________________________
activation_264 (Activation)     (None, 14, 14, 256)  0           batch_normalization_264[0][0]    
__________________________________________________________________________________________________
block8_1_mixed (Concatenate)    (None, 14, 14, 448)  0           activation_261[0][0]             
                                                                 activation_264[0][0]             
__________________________________________________________________________________________________
block8_1_conv (Conv2D)          (None, 14, 14, 2080) 933920      block8_1_mixed[0][0]             
__________________________________________________________________________________________________
block8_1 (Lambda)               (None, 14, 14, 2080) 0           mixed_7a[0][0]                   
                                                                 block8_1_conv[0][0]              
__________________________________________________________________________________________________
block8_1_ac (Activation)        (None, 14, 14, 2080) 0           block8_1[0][0]                   
__________________________________________________________________________________________________
conv2d_297 (Conv2D)             (None, 14, 14, 192)  399360      block8_1_ac[0][0]                
__________________________________________________________________________________________________
batch_normalization_266 (BatchN (None, 14, 14, 192)  576         conv2d_297[0][0]                 
__________________________________________________________________________________________________
activation_266 (Activation)     (None, 14, 14, 192)  0           batch_normalization_266[0][0]    
__________________________________________________________________________________________________
conv2d_298 (Conv2D)             (None, 14, 14, 224)  129024      activation_266[0][0]             
__________________________________________________________________________________________________
batch_normalization_267 (BatchN (None, 14, 14, 224)  672         conv2d_298[0][0]                 
__________________________________________________________________________________________________
activation_267 (Activation)     (None, 14, 14, 224)  0           batch_normalization_267[0][0]    
__________________________________________________________________________________________________
conv2d_296 (Conv2D)             (None, 14, 14, 192)  399360      block8_1_ac[0][0]                
__________________________________________________________________________________________________
conv2d_299 (Conv2D)             (None, 14, 14, 256)  172032      activation_267[0][0]             
__________________________________________________________________________________________________
batch_normalization_265 (BatchN (None, 14, 14, 192)  576         conv2d_296[0][0]                 
__________________________________________________________________________________________________
batch_normalization_268 (BatchN (None, 14, 14, 256)  768         conv2d_299[0][0]                 
__________________________________________________________________________________________________
activation_265 (Activation)     (None, 14, 14, 192)  0           batch_normalization_265[0][0]    
__________________________________________________________________________________________________
activation_268 (Activation)     (None, 14, 14, 256)  0           batch_normalization_268[0][0]    
__________________________________________________________________________________________________
block8_2_mixed (Concatenate)    (None, 14, 14, 448)  0           activation_265[0][0]             
                                                                 activation_268[0][0]             
__________________________________________________________________________________________________
block8_2_conv (Conv2D)          (None, 14, 14, 2080) 933920      block8_2_mixed[0][0]             
__________________________________________________________________________________________________
block8_2 (Lambda)               (None, 14, 14, 2080) 0           block8_1_ac[0][0]                
                                                                 block8_2_conv[0][0]              
__________________________________________________________________________________________________
block8_2_ac (Activation)        (None, 14, 14, 2080) 0           block8_2[0][0]                   
__________________________________________________________________________________________________
conv2d_301 (Conv2D)             (None, 14, 14, 192)  399360      block8_2_ac[0][0]                
__________________________________________________________________________________________________
batch_normalization_270 (BatchN (None, 14, 14, 192)  576         conv2d_301[0][0]                 
__________________________________________________________________________________________________
activation_270 (Activation)     (None, 14, 14, 192)  0           batch_normalization_270[0][0]    
__________________________________________________________________________________________________
conv2d_302 (Conv2D)             (None, 14, 14, 224)  129024      activation_270[0][0]             
__________________________________________________________________________________________________
batch_normalization_271 (BatchN (None, 14, 14, 224)  672         conv2d_302[0][0]                 
__________________________________________________________________________________________________
activation_271 (Activation)     (None, 14, 14, 224)  0           batch_normalization_271[0][0]    
__________________________________________________________________________________________________
conv2d_300 (Conv2D)             (None, 14, 14, 192)  399360      block8_2_ac[0][0]                
__________________________________________________________________________________________________
conv2d_303 (Conv2D)             (None, 14, 14, 256)  172032      activation_271[0][0]             
__________________________________________________________________________________________________
batch_normalization_269 (BatchN (None, 14, 14, 192)  576         conv2d_300[0][0]                 
__________________________________________________________________________________________________
batch_normalization_272 (BatchN (None, 14, 14, 256)  768         conv2d_303[0][0]                 
__________________________________________________________________________________________________
activation_269 (Activation)     (None, 14, 14, 192)  0           batch_normalization_269[0][0]    
__________________________________________________________________________________________________
activation_272 (Activation)     (None, 14, 14, 256)  0           batch_normalization_272[0][0]    
__________________________________________________________________________________________________
block8_3_mixed (Concatenate)    (None, 14, 14, 448)  0           activation_269[0][0]             
                                                                 activation_272[0][0]             
__________________________________________________________________________________________________
block8_3_conv (Conv2D)          (None, 14, 14, 2080) 933920      block8_3_mixed[0][0]             
__________________________________________________________________________________________________
block8_3 (Lambda)               (None, 14, 14, 2080) 0           block8_2_ac[0][0]                
                                                                 block8_3_conv[0][0]              
__________________________________________________________________________________________________
block8_3_ac (Activation)        (None, 14, 14, 2080) 0           block8_3[0][0]                   
__________________________________________________________________________________________________
conv2d_305 (Conv2D)             (None, 14, 14, 192)  399360      block8_3_ac[0][0]                
__________________________________________________________________________________________________
batch_normalization_274 (BatchN (None, 14, 14, 192)  576         conv2d_305[0][0]                 
__________________________________________________________________________________________________
activation_274 (Activation)     (None, 14, 14, 192)  0           batch_normalization_274[0][0]    
__________________________________________________________________________________________________
conv2d_306 (Conv2D)             (None, 14, 14, 224)  129024      activation_274[0][0]             
__________________________________________________________________________________________________
batch_normalization_275 (BatchN (None, 14, 14, 224)  672         conv2d_306[0][0]                 
__________________________________________________________________________________________________
activation_275 (Activation)     (None, 14, 14, 224)  0           batch_normalization_275[0][0]    
__________________________________________________________________________________________________
conv2d_304 (Conv2D)             (None, 14, 14, 192)  399360      block8_3_ac[0][0]                
__________________________________________________________________________________________________
conv2d_307 (Conv2D)             (None, 14, 14, 256)  172032      activation_275[0][0]             
__________________________________________________________________________________________________
batch_normalization_273 (BatchN (None, 14, 14, 192)  576         conv2d_304[0][0]                 
__________________________________________________________________________________________________
batch_normalization_276 (BatchN (None, 14, 14, 256)  768         conv2d_307[0][0]                 
__________________________________________________________________________________________________
activation_273 (Activation)     (None, 14, 14, 192)  0           batch_normalization_273[0][0]    
__________________________________________________________________________________________________
activation_276 (Activation)     (None, 14, 14, 256)  0           batch_normalization_276[0][0]    
__________________________________________________________________________________________________
block8_4_mixed (Concatenate)    (None, 14, 14, 448)  0           activation_273[0][0]             
                                                                 activation_276[0][0]             
__________________________________________________________________________________________________
block8_4_conv (Conv2D)          (None, 14, 14, 2080) 933920      block8_4_mixed[0][0]             
__________________________________________________________________________________________________
block8_4 (Lambda)               (None, 14, 14, 2080) 0           block8_3_ac[0][0]                
                                                                 block8_4_conv[0][0]              
__________________________________________________________________________________________________
block8_4_ac (Activation)        (None, 14, 14, 2080) 0           block8_4[0][0]                   
__________________________________________________________________________________________________
conv2d_309 (Conv2D)             (None, 14, 14, 192)  399360      block8_4_ac[0][0]                
__________________________________________________________________________________________________
batch_normalization_278 (BatchN (None, 14, 14, 192)  576         conv2d_309[0][0]                 
__________________________________________________________________________________________________
activation_278 (Activation)     (None, 14, 14, 192)  0           batch_normalization_278[0][0]    
__________________________________________________________________________________________________
conv2d_310 (Conv2D)             (None, 14, 14, 224)  129024      activation_278[0][0]             
__________________________________________________________________________________________________
batch_normalization_279 (BatchN (None, 14, 14, 224)  672         conv2d_310[0][0]                 
__________________________________________________________________________________________________
activation_279 (Activation)     (None, 14, 14, 224)  0           batch_normalization_279[0][0]    
__________________________________________________________________________________________________
conv2d_308 (Conv2D)             (None, 14, 14, 192)  399360      block8_4_ac[0][0]                
__________________________________________________________________________________________________
conv2d_311 (Conv2D)             (None, 14, 14, 256)  172032      activation_279[0][0]             
__________________________________________________________________________________________________
batch_normalization_277 (BatchN (None, 14, 14, 192)  576         conv2d_308[0][0]                 
__________________________________________________________________________________________________
batch_normalization_280 (BatchN (None, 14, 14, 256)  768         conv2d_311[0][0]                 
__________________________________________________________________________________________________
activation_277 (Activation)     (None, 14, 14, 192)  0           batch_normalization_277[0][0]    
__________________________________________________________________________________________________
activation_280 (Activation)     (None, 14, 14, 256)  0           batch_normalization_280[0][0]    
__________________________________________________________________________________________________
block8_5_mixed (Concatenate)    (None, 14, 14, 448)  0           activation_277[0][0]             
                                                                 activation_280[0][0]             
__________________________________________________________________________________________________
block8_5_conv (Conv2D)          (None, 14, 14, 2080) 933920      block8_5_mixed[0][0]             
__________________________________________________________________________________________________
block8_5 (Lambda)               (None, 14, 14, 2080) 0           block8_4_ac[0][0]                
                                                                 block8_5_conv[0][0]              
__________________________________________________________________________________________________
block8_5_ac (Activation)        (None, 14, 14, 2080) 0           block8_5[0][0]                   
__________________________________________________________________________________________________
conv2d_313 (Conv2D)             (None, 14, 14, 192)  399360      block8_5_ac[0][0]                
__________________________________________________________________________________________________
batch_normalization_282 (BatchN (None, 14, 14, 192)  576         conv2d_313[0][0]                 
__________________________________________________________________________________________________
activation_282 (Activation)     (None, 14, 14, 192)  0           batch_normalization_282[0][0]    
__________________________________________________________________________________________________
conv2d_314 (Conv2D)             (None, 14, 14, 224)  129024      activation_282[0][0]             
__________________________________________________________________________________________________
batch_normalization_283 (BatchN (None, 14, 14, 224)  672         conv2d_314[0][0]                 
__________________________________________________________________________________________________
activation_283 (Activation)     (None, 14, 14, 224)  0           batch_normalization_283[0][0]    
__________________________________________________________________________________________________
conv2d_312 (Conv2D)             (None, 14, 14, 192)  399360      block8_5_ac[0][0]                
__________________________________________________________________________________________________
conv2d_315 (Conv2D)             (None, 14, 14, 256)  172032      activation_283[0][0]             
__________________________________________________________________________________________________
batch_normalization_281 (BatchN (None, 14, 14, 192)  576         conv2d_312[0][0]                 
__________________________________________________________________________________________________
batch_normalization_284 (BatchN (None, 14, 14, 256)  768         conv2d_315[0][0]                 
__________________________________________________________________________________________________
activation_281 (Activation)     (None, 14, 14, 192)  0           batch_normalization_281[0][0]    
__________________________________________________________________________________________________
activation_284 (Activation)     (None, 14, 14, 256)  0           batch_normalization_284[0][0]    
__________________________________________________________________________________________________
block8_6_mixed (Concatenate)    (None, 14, 14, 448)  0           activation_281[0][0]             
                                                                 activation_284[0][0]             
__________________________________________________________________________________________________
block8_6_conv (Conv2D)          (None, 14, 14, 2080) 933920      block8_6_mixed[0][0]             
__________________________________________________________________________________________________
block8_6 (Lambda)               (None, 14, 14, 2080) 0           block8_5_ac[0][0]                
                                                                 block8_6_conv[0][0]              
__________________________________________________________________________________________________
block8_6_ac (Activation)        (None, 14, 14, 2080) 0           block8_6[0][0]                   
__________________________________________________________________________________________________
conv2d_317 (Conv2D)             (None, 14, 14, 192)  399360      block8_6_ac[0][0]                
__________________________________________________________________________________________________
batch_normalization_286 (BatchN (None, 14, 14, 192)  576         conv2d_317[0][0]                 
__________________________________________________________________________________________________
activation_286 (Activation)     (None, 14, 14, 192)  0           batch_normalization_286[0][0]    
__________________________________________________________________________________________________
conv2d_318 (Conv2D)             (None, 14, 14, 224)  129024      activation_286[0][0]             
__________________________________________________________________________________________________
batch_normalization_287 (BatchN (None, 14, 14, 224)  672         conv2d_318[0][0]                 
__________________________________________________________________________________________________
activation_287 (Activation)     (None, 14, 14, 224)  0           batch_normalization_287[0][0]    
__________________________________________________________________________________________________
conv2d_316 (Conv2D)             (None, 14, 14, 192)  399360      block8_6_ac[0][0]                
__________________________________________________________________________________________________
conv2d_319 (Conv2D)             (None, 14, 14, 256)  172032      activation_287[0][0]             
__________________________________________________________________________________________________
batch_normalization_285 (BatchN (None, 14, 14, 192)  576         conv2d_316[0][0]                 
__________________________________________________________________________________________________
batch_normalization_288 (BatchN (None, 14, 14, 256)  768         conv2d_319[0][0]                 
__________________________________________________________________________________________________
activation_285 (Activation)     (None, 14, 14, 192)  0           batch_normalization_285[0][0]    
__________________________________________________________________________________________________
activation_288 (Activation)     (None, 14, 14, 256)  0           batch_normalization_288[0][0]    
__________________________________________________________________________________________________
block8_7_mixed (Concatenate)    (None, 14, 14, 448)  0           activation_285[0][0]             
                                                                 activation_288[0][0]             
__________________________________________________________________________________________________
block8_7_conv (Conv2D)          (None, 14, 14, 2080) 933920      block8_7_mixed[0][0]             
__________________________________________________________________________________________________
block8_7 (Lambda)               (None, 14, 14, 2080) 0           block8_6_ac[0][0]                
                                                                 block8_7_conv[0][0]              
__________________________________________________________________________________________________
block8_7_ac (Activation)        (None, 14, 14, 2080) 0           block8_7[0][0]                   
__________________________________________________________________________________________________
conv2d_321 (Conv2D)             (None, 14, 14, 192)  399360      block8_7_ac[0][0]                
__________________________________________________________________________________________________
batch_normalization_290 (BatchN (None, 14, 14, 192)  576         conv2d_321[0][0]                 
__________________________________________________________________________________________________
activation_290 (Activation)     (None, 14, 14, 192)  0           batch_normalization_290[0][0]    
__________________________________________________________________________________________________
conv2d_322 (Conv2D)             (None, 14, 14, 224)  129024      activation_290[0][0]             
__________________________________________________________________________________________________
batch_normalization_291 (BatchN (None, 14, 14, 224)  672         conv2d_322[0][0]                 
__________________________________________________________________________________________________
activation_291 (Activation)     (None, 14, 14, 224)  0           batch_normalization_291[0][0]    
__________________________________________________________________________________________________
conv2d_320 (Conv2D)             (None, 14, 14, 192)  399360      block8_7_ac[0][0]                
__________________________________________________________________________________________________
conv2d_323 (Conv2D)             (None, 14, 14, 256)  172032      activation_291[0][0]             
__________________________________________________________________________________________________
batch_normalization_289 (BatchN (None, 14, 14, 192)  576         conv2d_320[0][0]                 
__________________________________________________________________________________________________
batch_normalization_292 (BatchN (None, 14, 14, 256)  768         conv2d_323[0][0]                 
__________________________________________________________________________________________________
activation_289 (Activation)     (None, 14, 14, 192)  0           batch_normalization_289[0][0]    
__________________________________________________________________________________________________
activation_292 (Activation)     (None, 14, 14, 256)  0           batch_normalization_292[0][0]    
__________________________________________________________________________________________________
block8_8_mixed (Concatenate)    (None, 14, 14, 448)  0           activation_289[0][0]             
                                                                 activation_292[0][0]             
__________________________________________________________________________________________________
block8_8_conv (Conv2D)          (None, 14, 14, 2080) 933920      block8_8_mixed[0][0]             
__________________________________________________________________________________________________
block8_8 (Lambda)               (None, 14, 14, 2080) 0           block8_7_ac[0][0]                
                                                                 block8_8_conv[0][0]              
__________________________________________________________________________________________________
block8_8_ac (Activation)        (None, 14, 14, 2080) 0           block8_8[0][0]                   
__________________________________________________________________________________________________
conv2d_325 (Conv2D)             (None, 14, 14, 192)  399360      block8_8_ac[0][0]                
__________________________________________________________________________________________________
batch_normalization_294 (BatchN (None, 14, 14, 192)  576         conv2d_325[0][0]                 
__________________________________________________________________________________________________
activation_294 (Activation)     (None, 14, 14, 192)  0           batch_normalization_294[0][0]    
__________________________________________________________________________________________________
conv2d_326 (Conv2D)             (None, 14, 14, 224)  129024      activation_294[0][0]             
__________________________________________________________________________________________________
batch_normalization_295 (BatchN (None, 14, 14, 224)  672         conv2d_326[0][0]                 
__________________________________________________________________________________________________
activation_295 (Activation)     (None, 14, 14, 224)  0           batch_normalization_295[0][0]    
__________________________________________________________________________________________________
conv2d_324 (Conv2D)             (None, 14, 14, 192)  399360      block8_8_ac[0][0]                
__________________________________________________________________________________________________
conv2d_327 (Conv2D)             (None, 14, 14, 256)  172032      activation_295[0][0]             
__________________________________________________________________________________________________
batch_normalization_293 (BatchN (None, 14, 14, 192)  576         conv2d_324[0][0]                 
__________________________________________________________________________________________________
batch_normalization_296 (BatchN (None, 14, 14, 256)  768         conv2d_327[0][0]                 
__________________________________________________________________________________________________
activation_293 (Activation)     (None, 14, 14, 192)  0           batch_normalization_293[0][0]    
__________________________________________________________________________________________________
activation_296 (Activation)     (None, 14, 14, 256)  0           batch_normalization_296[0][0]    
__________________________________________________________________________________________________
block8_9_mixed (Concatenate)    (None, 14, 14, 448)  0           activation_293[0][0]             
                                                                 activation_296[0][0]             
__________________________________________________________________________________________________
block8_9_conv (Conv2D)          (None, 14, 14, 2080) 933920      block8_9_mixed[0][0]             
__________________________________________________________________________________________________
block8_9 (Lambda)               (None, 14, 14, 2080) 0           block8_8_ac[0][0]                
                                                                 block8_9_conv[0][0]              
__________________________________________________________________________________________________
block8_9_ac (Activation)        (None, 14, 14, 2080) 0           block8_9[0][0]                   
__________________________________________________________________________________________________
conv2d_329 (Conv2D)             (None, 14, 14, 192)  399360      block8_9_ac[0][0]                
__________________________________________________________________________________________________
batch_normalization_298 (BatchN (None, 14, 14, 192)  576         conv2d_329[0][0]                 
__________________________________________________________________________________________________
activation_298 (Activation)     (None, 14, 14, 192)  0           batch_normalization_298[0][0]    
__________________________________________________________________________________________________
conv2d_330 (Conv2D)             (None, 14, 14, 224)  129024      activation_298[0][0]             
__________________________________________________________________________________________________
batch_normalization_299 (BatchN (None, 14, 14, 224)  672         conv2d_330[0][0]                 
__________________________________________________________________________________________________
activation_299 (Activation)     (None, 14, 14, 224)  0           batch_normalization_299[0][0]    
__________________________________________________________________________________________________
conv2d_328 (Conv2D)             (None, 14, 14, 192)  399360      block8_9_ac[0][0]                
__________________________________________________________________________________________________
conv2d_331 (Conv2D)             (None, 14, 14, 256)  172032      activation_299[0][0]             
__________________________________________________________________________________________________
batch_normalization_297 (BatchN (None, 14, 14, 192)  576         conv2d_328[0][0]                 
__________________________________________________________________________________________________
batch_normalization_300 (BatchN (None, 14, 14, 256)  768         conv2d_331[0][0]                 
__________________________________________________________________________________________________
activation_297 (Activation)     (None, 14, 14, 192)  0           batch_normalization_297[0][0]    
__________________________________________________________________________________________________
activation_300 (Activation)     (None, 14, 14, 256)  0           batch_normalization_300[0][0]    
__________________________________________________________________________________________________
block8_10_mixed (Concatenate)   (None, 14, 14, 448)  0           activation_297[0][0]             
                                                                 activation_300[0][0]             
__________________________________________________________________________________________________
block8_10_conv (Conv2D)         (None, 14, 14, 2080) 933920      block8_10_mixed[0][0]            
__________________________________________________________________________________________________
block8_10 (Lambda)              (None, 14, 14, 2080) 0           block8_9_ac[0][0]                
                                                                 block8_10_conv[0][0]             
__________________________________________________________________________________________________
conv_7b (Conv2D)                (None, 14, 14, 1536) 3194880     block8_10[0][0]                  
__________________________________________________________________________________________________
conv_7b_bn (BatchNormalization) (None, 14, 14, 1536) 4608        conv_7b[0][0]                    
__________________________________________________________________________________________________
conv_7b_ac (Activation)         (None, 14, 14, 1536) 0           conv_7b_bn[0][0]                 
__________________________________________________________________________________________________
global_average_pooling2d_3 (Glo (None, 1536)         0           conv_7b_ac[0][0]                 
__________________________________________________________________________________________________
dense_12 (Dense)                (None, 516)          793092      global_average_pooling2d_3[0][0] 
__________________________________________________________________________________________________
dropout_6 (Dropout)             (None, 516)          0           dense_12[0][0]                   
__________________________________________________________________________________________________
dense_13 (Dense)                (None, 256)          132352      dropout_6[0][0]                  
__________________________________________________________________________________________________
dropout_7 (Dropout)             (None, 256)          0           dense_13[0][0]                   
__________________________________________________________________________________________________
dense_14 (Dense)                (None, 64)           16448       dropout_7[0][0]                  
__________________________________________________________________________________________________
dense_15 (Dense)                (None, 2)            130         dense_14[0][0]                   
==================================================================================================
Total params: 55,278,758
Trainable params: 13,383,078
Non-trainable params: 41,895,680
__________________________________________________________________________________________________
None
In [24]:
# Define modifier to replace the sigmoid function of the last layer to a linear function
def model_modifier(m):
    m.layers[-1].activation = tf.keras.activations.linear

# Define losses functions. 0 is the index for a normal MRI
loss_normal = lambda output: K.mean(output[:, 0])

# Define losses functions. 2 is the index for a PVNH MRI
loss_PVNH = lambda output: K.mean(output[:, 1])
    
# Create Gradcam object
gradcam = Gradcam(model, model_modifier)

# Create Saliency object
saliency = Saliency(model, model_modifier)

# Iterate through the MRIs in test set

# Set background to white color
plt.rcParams['axes.facecolor']='white'
plt.rcParams['figure.facecolor']='white'
plt.rcParams['figure.edgecolor']='white'


print('\n \n' + '\033[1m' + 'EACH ORIGINAL MRI IS ANALYZED WITH TWO METHODS: CLASS ACTIVATION MAP (UPPER ROW) AND SALIENCY MAP (LOWER ROW)' + '\033[0m' + '\n')
print('\033[1m' + 'EACH MAP IS SUPERIMPOSED ON THE ORIGINAL MRI WITH A TRANSPARENCY THAT IS INVERSELY PROPORTIONAL TO THE ESTIMATED PROBABILITY OF THE MRI BELONGING TO THAT CATEGORY (NORMAL MRI OR PERIVENTRICULAR NODULAR HETEROTOPIA) \n \nHIGHER ESTIMATED PROBABILITIES PRODUCE CLEARLY SEEN MAPS OVERLAID ON THE ORIGINAL MRI AND LOWER ESTIMATED PROBABILITIES PRODUCE VERY TRANSPARENT OR NOT APPRECIABLE MAPS OVERLAID ON THE ORIGINAL MRI' + '\033[0m'+ '\n')


# print images 500 to 524
for i in range(500, 523):
    
    # Print spaces to separate from the next image
    print('\n \n \n \n \n \n')
  
    # Print real classification of the image
    if y_true[i]==0:
        real_classification='Normal MRI'
    else:
        real_classification='PVNH'
        
    print('\033[1m' + 'REAL CLASSIFICATION OF THE IMAGE: {}'.format(real_classification) + '\033[0m')
   
    # Print model classification and model probability of MCD
    if y_predInceptionResNetV2[i]==0:
        predicted_classification='Normal MRI'
    else:
        predicted_classification='PVNH'   
    
    print('\033[1m' + 'MODEL CLASSIFICATION OF THE IMAGE: {}'.format(predicted_classification)  + '\033[0m \n') 
    print('\033[1m' + '   Prob. Normal MRI: {:.4f}    '.format(testInceptionResNetV2[i][0]) + 'Prob. PVNH: {:.4f}'.format(testInceptionResNetV2[i][1]) + '\033[0m')
  
    
    # Arrays to plot
    original_image=shuffled_test_X[i]
    list_heatmaps=[
        # GradCam heatmap for normal MRI
        normalize(gradcam(loss_normal, shuffled_test_X[i])),
        # GradCam heatmap for PVNH
        normalize(gradcam(loss_PVNH, shuffled_test_X[i])),
        
        # Saliency heatmap for normal MRI
        normalize(saliency(loss_normal, seed_input=np.expand_dims(shuffled_test_X[i], axis=0), smooth_noise=0.2)),
        # Saliency heatmap for PVNH
        normalize(saliency(loss_PVNH, seed_input=np.expand_dims(shuffled_test_X[i], axis=0), smooth_noise=0.2))
    ]
    
    # Define figure
    f=plt.figure(figsize=(20, 8))

    # Define the image grid
    grid = ImageGrid(f, 111,
                nrows_ncols=(2, 2),
                axes_pad=0.05,
                share_all=True,
                cbar_location="right",
                cbar_mode=None,
                cbar_size="2%",
                cbar_pad=0.15)

    
    # Iterate over the graphs
    for j, axis in enumerate(grid):
        # Plot original 
        im=axis.imshow(original_image)
        im=axis.imshow(list_heatmaps[j][0], cmap='jet', alpha=0.5*testInceptionResNetV2[i][j%2])
        im=axis.set_xticks([])
        im=axis.set_yticks([])
    
    # Create scalarmappable for obtaining the colorbar from 0 to 1
    sm = plt.cm.ScalarMappable(cmap='jet', norm=plt.Normalize(vmin=0, vmax=1))
    plt.colorbar(sm)
    plt.show()
 
EACH ORIGINAL MRI IS ANALYZED WITH TWO METHODS: CLASS ACTIVATION MAP (UPPER ROW) AND SALIENCY MAP (LOWER ROW)

EACH MAP IS SUPERIMPOSED ON THE ORIGINAL MRI WITH A TRANSPARENCY THAT IS INVERSELY PROPORTIONAL TO THE ESTIMATED PROBABILITY OF THE MRI BELONGING TO THAT CATEGORY (NORMAL MRI OR PERIVENTRICULAR NODULAR HETEROTOPIA) 
 
HIGHER ESTIMATED PROBABILITIES PRODUCE CLEARLY SEEN MAPS OVERLAID ON THE ORIGINAL MRI AND LOWER ESTIMATED PROBABILITIES PRODUCE VERY TRANSPARENT OR NOT APPRECIABLE MAPS OVERLAID ON THE ORIGINAL MRI


 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0688    Prob. PVNH: 0.9312
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: PVNH
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0000    Prob. PVNH: 1.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: PVNH
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0000    Prob. PVNH: 1.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: Normal MRI 

   Prob. Normal MRI: 1.0000    Prob. PVNH: 0.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: Normal MRI 

   Prob. Normal MRI: 0.9999    Prob. PVNH: 0.0001
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: PVNH
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0000    Prob. PVNH: 1.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: PVNH
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0000    Prob. PVNH: 1.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: Normal MRI 

   Prob. Normal MRI: 1.0000    Prob. PVNH: 0.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0003    Prob. PVNH: 0.9997
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: PVNH
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0000    Prob. PVNH: 1.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.2038    Prob. PVNH: 0.7962
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0000    Prob. PVNH: 1.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0126    Prob. PVNH: 0.9874
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: Normal MRI 

   Prob. Normal MRI: 1.0000    Prob. PVNH: 0.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: Normal MRI 

   Prob. Normal MRI: 0.9994    Prob. PVNH: 0.0006
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: Normal MRI 

   Prob. Normal MRI: 1.0000    Prob. PVNH: 0.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: Normal MRI 

   Prob. Normal MRI: 1.0000    Prob. PVNH: 0.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: Normal MRI 

   Prob. Normal MRI: 0.9994    Prob. PVNH: 0.0006
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: Normal MRI 

   Prob. Normal MRI: 0.9991    Prob. PVNH: 0.0009
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0006    Prob. PVNH: 0.9994
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: Normal MRI
MODEL CLASSIFICATION OF THE IMAGE: Normal MRI 

   Prob. Normal MRI: 1.0000    Prob. PVNH: 0.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: PVNH
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.0000    Prob. PVNH: 1.0000
 
 
 
 
 

REAL CLASSIFICATION OF THE IMAGE: PVNH
MODEL CLASSIFICATION OF THE IMAGE: PVNH 

   Prob. Normal MRI: 0.4007    Prob. PVNH: 0.5993

SCROLL UP TO SEE THE GradCAM AND SALIENCY MAPS

Each original image is analyzed with two methods: Gradient-weighted class activation maps (upper row) and saliency maps (lower row).

Each map is superimposed on the original MRI with a transparency that is inversely proportional to the estimated probability of the MRI belonging to that category (normal MRI or periventricular nodular heterotopia). Higher estimated probabilities produce clearly seen maps overlaid on the original MRI and lower estimated probabilities produce very transparent or not appreciable maps overlaid on the original MRI.